-- Logs begin at Fri 2022-08-12 00:35:52 UTC, end at Fri 2022-08-12 01:47:45 UTC. -- Aug 12 01:19:42.503003 dv-cinder-784815-15-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 12 01:19:42.510714 dv-cinder-784815-15-iscsi devstack@n-api.service[105518]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 12 01:19:42.513206 dv-cinder-784815-15-iscsi devstack@n-api.service[105518]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 12 01:19:42 2022] *** Aug 12 01:19:42.513206 dv-cinder-784815-15-iscsi devstack@n-api.service[105518]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 12 01:19:42.513206 dv-cinder-784815-15-iscsi devstack@n-api.service[105518]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 12 01:19:42.513206 dv-cinder-784815-15-iscsi devstack@n-api.service[105518]: nodename: dv-cinder-784815-15-iscsi Aug 12 01:19:42.513206 dv-cinder-784815-15-iscsi devstack@n-api.service[105518]: machine: x86_64 Aug 12 01:19:42.513206 dv-cinder-784815-15-iscsi devstack@n-api.service[105518]: clock source: unix Aug 12 01:19:42.513206 dv-cinder-784815-15-iscsi devstack@n-api.service[105518]: pcre jit disabled Aug 12 01:19:42.513206 dv-cinder-784815-15-iscsi devstack@n-api.service[105518]: detected number of CPU cores: 4 Aug 12 01:19:42.513206 dv-cinder-784815-15-iscsi devstack@n-api.service[105518]: current working directory: / Aug 12 01:19:42.513206 dv-cinder-784815-15-iscsi devstack@n-api.service[105518]: detected binary path: /usr/bin/uwsgi-core Aug 12 01:19:42.513206 dv-cinder-784815-15-iscsi devstack@n-api.service[105518]: your processes number limit is 47680 Aug 12 01:19:42.513206 dv-cinder-784815-15-iscsi devstack@n-api.service[105518]: your memory page size is 4096 bytes Aug 12 01:19:42.513206 dv-cinder-784815-15-iscsi devstack@n-api.service[105518]: detected max file descriptor number: 2048 Aug 12 01:19:42.513206 dv-cinder-784815-15-iscsi devstack@n-api.service[105518]: lock engine: pthread robust mutexes Aug 12 01:19:42.514169 dv-cinder-784815-15-iscsi devstack@n-api.service[105518]: thunder lock: enabled Aug 12 01:19:42.514169 dv-cinder-784815-15-iscsi devstack@n-api.service[105518]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 12 01:19:42.514169 dv-cinder-784815-15-iscsi devstack@n-api.service[105518]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 12 01:19:42.552506 dv-cinder-784815-15-iscsi devstack@n-api.service[105518]: Python main interpreter initialized at 0x55ed8ae279c0 Aug 12 01:19:42.552506 dv-cinder-784815-15-iscsi devstack@n-api.service[105518]: python threads support enabled Aug 12 01:19:42.552506 dv-cinder-784815-15-iscsi devstack@n-api.service[105518]: your server socket listen backlog is limited to 100 connections Aug 12 01:19:42.552506 dv-cinder-784815-15-iscsi devstack@n-api.service[105518]: your mercy for graceful operations on workers is 90 seconds Aug 12 01:19:42.552856 dv-cinder-784815-15-iscsi devstack@n-api.service[105518]: mapped 403077 bytes (393 KB) for 2 cores Aug 12 01:19:42.552856 dv-cinder-784815-15-iscsi devstack@n-api.service[105518]: *** Operational MODE: preforking *** Aug 12 01:19:42.553155 dv-cinder-784815-15-iscsi devstack@n-api.service[105518]: *** uWSGI is running in multiple interpreter mode *** Aug 12 01:19:42.553155 dv-cinder-784815-15-iscsi devstack@n-api.service[105518]: spawned uWSGI master process (pid: 105518) Aug 12 01:19:42.553367 dv-cinder-784815-15-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 12 01:19:42.553839 dv-cinder-784815-15-iscsi devstack@n-api.service[105518]: spawned uWSGI worker 1 (pid: 105519, cores: 1) Aug 12 01:19:42.554174 dv-cinder-784815-15-iscsi devstack@n-api.service[105518]: spawned uWSGI worker 2 (pid: 105520, cores: 1) Aug 12 01:19:42.554340 dv-cinder-784815-15-iscsi devstack@n-api.service[105518]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 12 01:19:43.210436 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 12 01:19:43.211139 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 12 01:19:44.264612 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 01:19:44.264612 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: from cryptography.utils import int_from_bytes Aug 12 01:19:44.265363 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 01:19:44.265363 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: from cryptography.utils import int_from_bytes Aug 12 01:19:44.265363 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 01:19:44.265363 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: from cryptography.utils import int_from_bytes Aug 12 01:19:44.265849 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 01:19:44.265849 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: from cryptography.utils import int_from_bytes Aug 12 01:19:46.746378 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 12 01:19:46.746954 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 12 01:19:46.746954 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 12 01:19:46.747394 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 12 01:19:46.747472 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 12 01:19:46.747575 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 12 01:19:46.747660 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 12 01:19:46.747743 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 12 01:19:46.747817 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 12 01:19:46.747884 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 12 01:19:46.748071 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.748169 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.748399 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.748513 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.748731 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.748878 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.749045 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.749201 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.749333 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.749435 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.749680 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.749814 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.750023 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.750180 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.750279 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.750364 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.750590 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.750741 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.750834 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.750930 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.751134 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.751277 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.751448 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784815-15-iscsi {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.751622 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784815-15-iscsi {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.751794 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.751878 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.752123 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.752269 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.752403 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.752506 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.752735 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.752882 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.752982 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.753068 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.753315 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.753412 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.753607 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.753702 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.754089 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.754203 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.755263 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.755412 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.755412 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.755662 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.755752 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.755836 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.755925 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.756018 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.756018 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.756223 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.756223 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.756419 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.756511 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.756597 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.756597 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.756795 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.756878 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.756956 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.757178 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.757282 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.757562 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784815-15-iscsi {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.757667 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784815-15-iscsi {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.757870 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.757960 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.758173 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.758287 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.758476 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.758622 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.758855 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.758981 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.759158 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.759258 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.759457 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.759564 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.759794 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.759897 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.760112 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.760216 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.760409 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.760507 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.760724 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.760818 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.761035 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.761127 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.761346 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.761439 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.761656 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.761752 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.761945 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.762031 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.762247 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.762344 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.762543 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.762640 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.762849 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.762940 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.763142 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.763232 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.763441 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.763590 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.763702 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.763790 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.763999 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.764097 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.764311 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.764408 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.764625 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.764712 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.764938 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.765043 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.765180 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.765282 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.765420 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.765514 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.765730 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.765857 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.766040 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.766127 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.766336 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.766428 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.766633 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.766725 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.766928 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.767020 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.767226 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.767409 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.767588 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.767680 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.767888 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.767981 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.768183 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.768323 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.768484 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.768597 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.768793 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.768895 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.769102 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.769211 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.769414 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.769507 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.769712 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.769810 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.770025 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.770146 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.770408 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.770511 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.770650 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.770759 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.770947 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.771052 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.771276 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.771363 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.771606 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.771706 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.771906 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.772001 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.772215 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.772301 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.772524 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.772631 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.772824 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.772917 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.773120 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.773208 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.773417 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.773510 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.773727 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.773816 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.774053 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.774146 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.774348 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.774447 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.774588 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.774675 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.774878 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.774973 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.775171 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.775270 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.775478 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.775609 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.775798 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.775884 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.776096 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.776182 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.776395 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.776481 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.776686 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.776778 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.776980 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.777108 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.777278 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.777371 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.777572 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.777657 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.777866 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.777960 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.778161 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.778246 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.778451 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.778585 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.778755 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.778893 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.779039 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.779124 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.779333 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.779426 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.779667 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.779771 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.779981 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.780073 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.780279 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.780385 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.780574 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.780662 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.780867 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.780966 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.781165 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.781254 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.781477 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.781579 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.781775 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.781861 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.782072 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.782158 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.782382 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.782480 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.782677 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.782771 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.782996 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.783082 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.783303 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.783397 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.783625 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.783758 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.783926 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.784026 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.784237 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.784324 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.784529 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.784621 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.784824 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.784911 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.785130 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.785215 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.785427 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.785523 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.785720 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.785806 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.786011 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.786108 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.786303 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.786394 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.786594 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.786679 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.786887 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.786974 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.787179 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.787265 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.787469 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.787613 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.787783 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.787870 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.788090 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.788175 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.788399 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.788492 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.788695 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.788787 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.788991 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.789077 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.789284 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.789378 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.789594 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.789688 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:19:46.789916 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.790001 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.790236 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.790415 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.790575 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.790689 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.790877 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.790966 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.791200 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.791289 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.791521 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.791629 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.791850 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.791937 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.792152 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.792237 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.792457 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.792541 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.792775 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.792870 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.793077 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.793163 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.793379 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.793468 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.793680 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.793789 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.793990 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.794089 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.794298 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.794580 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.794679 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.794913 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.795006 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.795218 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.795310 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.795544 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.795632 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.795851 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.795953 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.796155 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.796247 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.796465 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.796561 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.796775 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.796861 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.797080 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.797174 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.797380 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.797465 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.797711 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.797797 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.798025 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.798109 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.798336 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.798421 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.798699 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.798814 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.799008 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.799122 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.799311 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.799399 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.799636 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.799737 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.799941 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.800028 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.800255 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.800356 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.800557 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.800657 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.800868 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.800975 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.801169 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.801272 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.801472 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.801559 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.801774 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.801859 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.802078 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.802178 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.802378 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.802465 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.802678 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.802764 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.802995 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.803094 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.803300 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.803385 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.803622 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.803711 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.803929 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.804032 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.804228 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.804313 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.804528 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.804614 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.804827 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.804914 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.805125 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.805211 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.805420 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.805513 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.805713 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.805806 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.806006 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.806092 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.806301 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.806387 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.806596 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.806690 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.807235 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.807342 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.807569 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.807660 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.807864 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.807951 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.808161 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.808254 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.808465 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.808568 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.808800 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.808882 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.809065 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.809140 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.809362 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.809446 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.809656 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.809731 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.809957 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.810032 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.810255 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.810339 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.810728 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.810827 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.811053 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.811266 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.811354 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.811667 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.811841 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.811987 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.812332 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.812419 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.812643 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.812911 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.813005 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.813251 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.813486 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.813573 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.813858 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.814052 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.814193 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.814535 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.814621 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.815079 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.815181 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.815395 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.815571 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.815746 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.815891 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.816062 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.816226 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.816374 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.816553 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.816707 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.816858 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.817033 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.817179 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.817335 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.817501 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.817657 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.817974 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.818167 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.818483 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.818568 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.818784 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.819080 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.819178 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.819378 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.819674 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.819776 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.819995 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.820240 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.820328 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.820588 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.820712 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.821017 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.821105 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.821330 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.821416 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.821638 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.821721 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.821945 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.822182 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.822269 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.822543 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.822764 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.822860 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.823161 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.823334 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.823462 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.823783 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.823915 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.824096 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.824450 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.824569 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.824761 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.825044 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.825211 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.825599 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.825816 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.825909 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.826245 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.826399 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.826581 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.826900 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.826996 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.827224 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.827411 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.827554 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.827871 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.827956 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.828182 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.828416 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.828512 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.828732 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.828825 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.829042 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.829127 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.829349 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.829444 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.829667 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.829754 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.830030 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.830123 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.830334 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.830420 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.830642 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.830799 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.830949 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.831080 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.831247 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.831337 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.831562 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.831664 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.831868 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.831955 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.832188 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.832283 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.832523 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.832611 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.832834 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.832920 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.833153 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.833244 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.833460 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.833547 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.833764 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.833858 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.834067 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.834154 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.834372 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.834461 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.834676 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.834775 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.834980 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.835068 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.835285 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.835371 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.835617 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.835720 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.835922 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.836011 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.836225 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.836310 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.836527 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.836628 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.836831 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.836919 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.837134 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.837220 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.837430 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.837524 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.837731 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.837824 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.838037 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.838124 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.838357 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.838446 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.838658 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.838743 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.838963 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.839092 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.839267 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.839361 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.839587 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.839676 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.839895 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.839981 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.840197 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.840286 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.840493 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.840577 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.840788 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.840874 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.841083 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.841170 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.841391 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.841479 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.841692 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.841796 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.841996 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.842092 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.842299 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.842403 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.842597 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.842710 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.842897 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.842991 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.843192 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.843286 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.843487 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.843623 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.843808 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.843907 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.844112 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.844198 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.844418 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.844514 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.844721 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.844806 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.845034 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.845125 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.845333 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.845430 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.845654 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.845740 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.845950 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.846034 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.846259 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.846345 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.846555 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.846642 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.846850 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.846937 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.847188 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.847298 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.847434 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.847520 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.847790 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.847877 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.848088 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.848175 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.848381 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.848465 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.848689 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.848784 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.848988 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.849074 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.849292 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.849391 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.849592 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.849686 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.849891 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.849976 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.850192 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.850277 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.850495 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.850593 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.850797 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.850897 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.851165 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.851265 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.851399 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.851617 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.851710 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.851799 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.852016 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.852105 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.852319 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.852415 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.852621 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.852751 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.852920 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.853015 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.853220 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.853307 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.853516 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.853602 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.853811 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.853899 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.854115 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.854203 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.854430 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.854688 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.854990 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.855079 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.855310 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.855404 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.855640 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.855728 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.855952 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.856055 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.856262 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.856348 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.856572 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.856657 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.856890 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.856988 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.857206 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.857289 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.857503 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.857596 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.857806 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.857906 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.858104 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.858190 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.858400 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.858487 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.858695 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.858787 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.858987 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.859080 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.859282 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.859368 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.859597 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.859686 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.859898 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.860001 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.860196 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.860282 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.860492 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.860584 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.860787 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.860880 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.861142 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.861246 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.861447 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.861544 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.861741 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.861836 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.862046 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.862141 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.862348 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.862434 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.862648 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.862743 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.862952 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.863044 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.863247 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.863341 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.863575 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.863665 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.863853 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.863953 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.864149 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.864241 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.864472 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.864558 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.864770 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.864872 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.865100 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.865186 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.865423 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.865510 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.865720 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.865814 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.866019 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.866117 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.866330 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.866415 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.866626 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.866711 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.866922 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.867016 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.867216 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.867302 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.867513 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.867663 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.867836 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.867936 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.868129 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.868213 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.868421 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.868505 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.868720 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.868885 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.869017 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.869102 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.869314 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.869405 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.869608 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.869696 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.869901 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.869986 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.870193 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.870277 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.870487 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.870572 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.870784 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.870868 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.871079 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.871163 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.871373 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.871482 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.871694 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.871792 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.871991 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.872077 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.872289 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.872376 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.872601 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.872745 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.872876 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.872978 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.873168 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.873263 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.873467 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.873552 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.873762 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.873857 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.874056 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.874140 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.874349 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.874433 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.874646 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.874783 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.874939 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.875026 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.875230 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.875322 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.875555 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.875657 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.875854 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.875940 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.876148 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.876232 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.876443 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.876537 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.876780 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.876870 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.877078 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.877162 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.877374 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.877462 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.877675 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.877761 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.877980 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.878065 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.878277 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.878363 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.878569 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.878653 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.878864 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.878954 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.879158 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.879244 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.879452 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.879555 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.879771 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.879874 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.880069 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.880154 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.880358 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.880442 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.880652 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.880753 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.880948 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.881034 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.881240 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.881332 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.881533 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.881635 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.881839 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.881926 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.882140 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.882225 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.882432 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.882532 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.882723 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.882807 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.883013 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.883098 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.883338 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.883431 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.883660 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.883752 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.883997 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.884084 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.884298 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.884392 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.884604 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.884689 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.884907 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.885007 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.885208 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.885295 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.885511 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.885602 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.885808 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.885901 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.886101 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.886188 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.886403 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.886486 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.886704 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.886790 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.886999 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.887085 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.887293 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.887378 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.887613 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.887717 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.887918 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.888002 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.888218 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.888302 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.888520 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.888619 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.888834 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.888918 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.889144 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.889236 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.889440 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.889533 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.889743 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.889836 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.890042 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.890126 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.890339 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.890434 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.890637 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.890722 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.890936 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.891020 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.891235 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.891321 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.891585 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.891674 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.891870 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.891986 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.892173 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.892275 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.892522 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.892620 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.892819 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.892923 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.893112 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.893207 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.893411 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.893512 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.893707 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.893802 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.893999 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.894095 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.894309 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.894413 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.894605 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.894708 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.894899 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.894994 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.895192 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.895285 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.895484 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.895616 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.895803 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.895889 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.896100 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.896224 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.896524 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.896692 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.896824 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.896911 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.897118 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.897209 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.897410 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.897506 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.897709 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.897807 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.898008 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.898104 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.898309 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.898397 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.898604 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.898690 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.898898 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.899009 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.899309 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.899407 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.899632 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.899723 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.899935 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.900034 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.900228 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.900314 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.900522 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.900608 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.900817 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.900904 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.901118 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.901214 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.901415 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.901519 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.901714 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.901818 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.902014 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.902111 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.902308 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.902395 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.902609 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.902709 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.902908 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.903002 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.903224 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.903317 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.903624 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.903728 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.903923 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.904017 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.904225 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.904320 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.904616 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.904710 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.904916 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.904999 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.905218 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.905311 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.905528 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.905615 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.905839 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.905924 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.906133 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.906218 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.906437 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.906533 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.906734 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.906830 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.907033 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.907119 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.907347 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.907441 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.907679 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.907779 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.908004 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.908100 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.908300 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.908386 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.908596 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.908683 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.908911 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.908999 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.909213 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.909299 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.909514 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.909622 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.909829 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.909930 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.910220 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.910320 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.910521 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.910609 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.910818 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.910911 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.911129 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.911224 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.911423 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.911509 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.911745 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.911834 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.912087 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.912197 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.912337 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.912424 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.912631 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.912730 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.912926 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.913022 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.913226 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.913311 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.913523 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.913620 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.913822 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.913912 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.914118 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.914206 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.914415 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.914500 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.914708 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.914804 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.915001 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.915094 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.915302 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.915404 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.915617 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.915709 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.915929 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.916015 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.916233 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.916318 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.916571 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.916685 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.916972 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.917079 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.917168 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.917257 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.917429 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.917515 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.917722 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.917818 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.918014 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.918115 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.918306 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.918399 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.918601 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.918694 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.918924 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.919021 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.919220 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.919314 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.919546 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.919636 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.919879 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.919983 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.920182 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.920268 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.920492 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.920578 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.920816 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.920905 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.921128 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.921221 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.921438 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.921532 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.921745 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.921878 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.922046 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.922147 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.922344 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.922444 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.922635 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.922737 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.922929 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.923023 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.923222 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.923310 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.923554 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.923685 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.923884 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.924008 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.924180 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.924287 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.924473 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.924568 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.924768 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.924869 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.925062 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.925183 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.925372 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.925474 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.925668 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.925768 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.925974 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.926081 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.926270 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.926372 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.926562 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.926655 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.926854 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.926955 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.927145 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.927240 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.927476 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.927600 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.927798 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.927886 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.928110 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.928194 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.928410 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.928495 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.928725 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.928814 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.929033 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.929118 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.929341 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.929426 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.929647 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.929779 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.929952 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.930046 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.930254 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.930339 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.930557 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.930650 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.930858 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.930944 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.931156 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.931249 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.931461 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.931570 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.932107 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.932200 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.932430 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.932626 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.932939 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.933025 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.933243 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.933327 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.933551 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.933646 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.933857 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.933965 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.934162 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.934263 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.934464 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.934563 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.934767 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.934852 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.935070 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.935155 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.935369 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.935465 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.935693 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.935781 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.935996 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.936084 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.936311 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.936397 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.936623 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.936710 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.936942 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.937036 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.937249 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.937343 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.937554 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.937647 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.937857 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.937950 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.938158 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.938243 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.938460 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.938553 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.938800 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.938886 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.939112 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.939198 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.939419 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.939503 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.939748 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.939895 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.940054 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.940140 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.940356 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.940440 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.940657 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.940744 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.940958 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.941050 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.941260 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.941354 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.941559 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.941644 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.941863 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.941955 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.942162 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.942265 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.942463 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.942590 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.942765 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.942851 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.943082 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.943176 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.943392 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.943477 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.943728 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.943815 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.944032 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.944152 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.944335 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.944423 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.944644 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.944838 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.945144 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.945229 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.945456 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.945541 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.945773 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.945858 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.946090 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.946180 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.946398 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.946491 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.946707 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.946793 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.947024 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.947118 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.947332 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.947518 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.947695 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.947786 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.948016 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.948162 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.948319 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.948622 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.948706 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.948920 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.950026 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.950128 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.950350 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.950438 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.950657 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.950753 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.950958 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.951044 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.951272 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.951358 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.951605 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.951828 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.952134 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.952222 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.952475 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.952590 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.952789 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.952883 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.953108 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.953196 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.953418 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.953507 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.953722 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.953832 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.954018 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.954105 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.954323 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.954430 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.954622 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.954711 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.954970 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.955061 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.955272 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.955367 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.955592 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.955704 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.955889 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.955975 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.956187 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.956283 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.956489 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.956575 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.956789 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.956876 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.957084 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.957179 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.957378 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.957464 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.957671 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.957756 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.957978 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.958072 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.958275 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.958364 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.958570 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.958657 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.958865 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.958961 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.959157 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.959245 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.959451 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.959557 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.959769 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.959865 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.960062 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.960151 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.960356 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.960443 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.960650 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.960738 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.960942 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.961036 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.961238 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.961324 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.961531 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.961617 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.961825 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.961913 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.962116 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.962208 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.962408 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.962502 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.962701 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.962841 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.963008 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.963123 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.963300 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.963391 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.963666 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.963770 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.963971 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.964067 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.964269 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.964371 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.964580 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.964677 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.964877 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.965041 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.965178 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.965266 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.965509 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.965610 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.965818 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.966032 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.966333 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.966422 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.966654 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.966741 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.966964 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.967051 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.967285 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.967371 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.967603 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.967691 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.967904 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.967993 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.968198 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.968292 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.968494 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.968585 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.968803 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.968890 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.969101 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.969187 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.969402 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.969495 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.969702 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.969788 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.970003 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.970107 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.970302 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.970397 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.970631 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.970726 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.970932 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.971018 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.971232 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.971332 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.971550 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.971639 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.971851 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.971938 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.972150 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.972238 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.972452 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.972540 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.972750 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.972878 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.973049 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.973139 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.973354 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.973442 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.973677 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.973762 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.973985 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.974072 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.974289 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.974374 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.974602 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.974734 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.974898 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.974997 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.975195 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.975301 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.975496 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.975618 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.975820 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.975909 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.976121 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.976223 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.976426 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.976521 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.976731 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.976818 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.977028 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.977114 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.977324 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.977442 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.977735 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.977822 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.978041 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.978133 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.978348 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.978435 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.978648 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.978733 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.978946 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.979039 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.979258 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.979344 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.979576 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.979665 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.979886 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.979983 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.980191 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.980283 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.980492 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.980584 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.980813 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.980908 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.981140 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.981232 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.981458 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.981540 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.981756 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.981860 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.982056 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.982151 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.982355 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.982451 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.982650 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.982746 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.982966 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.983051 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.983252 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.983343 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.983562 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.983651 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.983864 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.983949 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.984159 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.984256 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.984452 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.984539 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.984743 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.984831 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.985037 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.985122 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.985334 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.985419 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.985629 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.985715 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.985922 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.986073 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.986266 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.986361 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.986566 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.986660 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.986865 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.986959 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.987160 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.987252 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.987455 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.987561 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.987775 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.987879 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.988069 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.988155 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.988364 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.988451 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.988659 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.988753 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.988953 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.989038 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.989245 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.989347 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.989539 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.989637 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.989861 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.989948 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.990189 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.990274 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.990480 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.990566 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.990781 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.990865 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.991085 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.991170 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.991383 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.991477 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.991714 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.991800 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.992027 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.992111 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.992335 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.992422 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.992636 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.992721 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.992934 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.993018 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.993257 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.993344 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.993556 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.993641 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.993856 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.993950 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.994156 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.994250 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.994455 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.994540 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.994757 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.994886 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.995058 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.995151 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.995378 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.995475 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.995698 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.995797 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.996007 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.996137 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.996312 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.996442 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.996623 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.996720 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.996933 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.997017 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.997232 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.997317 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.997533 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.997621 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.997848 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.997934 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.998151 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.998235 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.998450 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.998537 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.998750 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.998836 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.999049 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.999148 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.999350 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.999435 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.999675 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.999765 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:46.999979 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:47.000076 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:47.000283 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:47.000375 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:47.000589 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:47.000674 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:47.000896 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:47.000989 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:47.001218 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:47.001304 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:47.001521 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:47.001629 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:47.001868 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:47.002080 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:47.002174 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:47.002411 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:47.002497 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:47.002736 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:47.002831 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:47.003077 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:47.003170 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:47.003384 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:47.003486 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:47.003748 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:47.003849 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:47.004053 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:47.004138 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:47.004352 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:47.004437 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:47.004590 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 12 01:19:47.004686 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:47.004944 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:19:47.005181 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 12 01:19:47.160581 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO dbcounter [None req-0131649f-0d22-4c9b-8e5e-4e65f342fdc6 None None] Registered counter for database nova_api Aug 12 01:19:47.161678 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO dbcounter [None req-b7ce2fea-ce05-4e1a-be7e-31fe9016ba90 None None] Registered counter for database nova_api Aug 12 01:19:47.183704 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG oslo_db.sqlalchemy.engines [None req-0131649f-0d22-4c9b-8e5e-4e65f342fdc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105520) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 01:19:47.185537 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG oslo_db.sqlalchemy.engines [None req-b7ce2fea-ce05-4e1a-be7e-31fe9016ba90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105519) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 01:19:47.190729 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG dbcounter [-] [105520] Writer thread running {{(pid=105520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 01:19:47.192460 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG dbcounter [-] [105519] Writer thread running {{(pid=105519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 01:19:47.245014 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.context [None req-0131649f-0d22-4c9b-8e5e-4e65f342fdc6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),330ae0cc-8e41-4294-877c-2d5d49260da2(cell1) {{(pid=105520) load_cells /opt/stack/nova/nova/context.py:464}} Aug 12 01:19:47.246777 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.context [None req-b7ce2fea-ce05-4e1a-be7e-31fe9016ba90 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),330ae0cc-8e41-4294-877c-2d5d49260da2(cell1) {{(pid=105519) load_cells /opt/stack/nova/nova/context.py:464}} Aug 12 01:19:47.248834 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG oslo_concurrency.lockutils [None req-0131649f-0d22-4c9b-8e5e-4e65f342fdc6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:19:47.249327 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG oslo_concurrency.lockutils [None req-0131649f-0d22-4c9b-8e5e-4e65f342fdc6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:19:47.250534 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG oslo_concurrency.lockutils [None req-b7ce2fea-ce05-4e1a-be7e-31fe9016ba90 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:19:47.250890 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG oslo_concurrency.lockutils [None req-0131649f-0d22-4c9b-8e5e-4e65f342fdc6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:19:47.251051 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG oslo_concurrency.lockutils [None req-b7ce2fea-ce05-4e1a-be7e-31fe9016ba90 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:19:47.251664 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG oslo_concurrency.lockutils [None req-0131649f-0d22-4c9b-8e5e-4e65f342fdc6 None None] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:19:47.252122 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG oslo_concurrency.lockutils [None req-0131649f-0d22-4c9b-8e5e-4e65f342fdc6 None None] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:19:47.252721 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG oslo_concurrency.lockutils [None req-b7ce2fea-ce05-4e1a-be7e-31fe9016ba90 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:19:47.253457 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG oslo_concurrency.lockutils [None req-b7ce2fea-ce05-4e1a-be7e-31fe9016ba90 None None] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:19:47.253886 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG oslo_concurrency.lockutils [None req-b7ce2fea-ce05-4e1a-be7e-31fe9016ba90 None None] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:19:47.254115 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG oslo_concurrency.lockutils [None req-0131649f-0d22-4c9b-8e5e-4e65f342fdc6 None None] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:19:47.255890 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG oslo_concurrency.lockutils [None req-b7ce2fea-ce05-4e1a-be7e-31fe9016ba90 None None] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:19:47.256043 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO dbcounter [None req-0131649f-0d22-4c9b-8e5e-4e65f342fdc6 None None] Registered counter for database nova_cell0 Aug 12 01:19:47.257838 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO dbcounter [None req-b7ce2fea-ce05-4e1a-be7e-31fe9016ba90 None None] Registered counter for database nova_cell0 Aug 12 01:19:47.261481 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO dbcounter [None req-0131649f-0d22-4c9b-8e5e-4e65f342fdc6 None None] Registered counter for database nova_cell1 Aug 12 01:19:47.263063 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO dbcounter [None req-b7ce2fea-ce05-4e1a-be7e-31fe9016ba90 None None] Registered counter for database nova_cell1 Aug 12 01:19:47.268900 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG oslo_db.sqlalchemy.engines [None req-0131649f-0d22-4c9b-8e5e-4e65f342fdc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105520) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 01:19:47.273573 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG dbcounter [-] [105520] Writer thread running {{(pid=105520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 01:19:47.274107 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG oslo_db.sqlalchemy.engines [None req-b7ce2fea-ce05-4e1a-be7e-31fe9016ba90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105519) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 01:19:47.274885 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG oslo_db.sqlalchemy.engines [None req-b7ce2fea-ce05-4e1a-be7e-31fe9016ba90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105519) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 01:19:47.277811 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG oslo_db.sqlalchemy.engines [None req-0131649f-0d22-4c9b-8e5e-4e65f342fdc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105520) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 01:19:47.281277 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG dbcounter [-] [105519] Writer thread running {{(pid=105519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 01:19:47.410068 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG dbcounter [-] [105520] Writer thread running {{(pid=105520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 01:19:47.413473 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG dbcounter [-] [105519] Writer thread running {{(pid=105519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 01:19:47.418677 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO dbcounter [None req-0131649f-0d22-4c9b-8e5e-4e65f342fdc6 None None] Registered counter for database nova_cell0 Aug 12 01:19:47.423562 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO dbcounter [None req-b7ce2fea-ce05-4e1a-be7e-31fe9016ba90 None None] Registered counter for database nova_cell0 Aug 12 01:19:47.427909 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG oslo_db.sqlalchemy.engines [None req-0131649f-0d22-4c9b-8e5e-4e65f342fdc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105520) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 01:19:47.432468 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG oslo_db.sqlalchemy.engines [None req-b7ce2fea-ce05-4e1a-be7e-31fe9016ba90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105519) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 01:19:47.433879 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG dbcounter [-] [105520] Writer thread running {{(pid=105520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 01:19:47.437062 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG dbcounter [-] [105519] Writer thread running {{(pid=105519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 01:19:47.768138 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: WARNING keystonemiddleware.auth_token [None req-b7ce2fea-ce05-4e1a-be7e-31fe9016ba90 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 01:19:47.773991 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: WARNING keystonemiddleware.auth_token [None req-0131649f-0d22-4c9b-8e5e-4e65f342fdc6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 01:19:47.775372 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: WARNING keystonemiddleware.auth_token [None req-b7ce2fea-ce05-4e1a-be7e-31fe9016ba90 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 01:19:47.781280 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: WARNING keystonemiddleware.auth_token [None req-0131649f-0d22-4c9b-8e5e-4e65f342fdc6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 01:19:48.112404 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: WARNING keystonemiddleware.auth_token [None req-b7ce2fea-ce05-4e1a-be7e-31fe9016ba90 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 01:19:48.118295 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: WARNING keystonemiddleware.auth_token [None req-b7ce2fea-ce05-4e1a-be7e-31fe9016ba90 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 01:19:48.120614 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: WARNING keystonemiddleware.auth_token [None req-0131649f-0d22-4c9b-8e5e-4e65f342fdc6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 01:19:48.123524 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ed8ae279c0 pid: 105519 (default app) Aug 12 01:19:48.125598 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-b7ce2fea-ce05-4e1a-be7e-31fe9016ba90 None None] Calling method '>' {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:19:48.126572 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: WARNING keystonemiddleware.auth_token [None req-0131649f-0d22-4c9b-8e5e-4e65f342fdc6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 01:19:48.126769 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.requestlog [None req-b7ce2fea-ce05-4e1a-be7e-31fe9016ba90 None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001690 Aug 12 01:19:48.127199 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: [pid: 105519|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Fri Aug 12 01:19:48 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:19:48.131901 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ed8ae279c0 pid: 105520 (default app) Aug 12 01:21:06.082933 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-b7ce2fea-ce05-4e1a-be7e-31fe9016ba90 None None] Calling method '>' {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:21:06.084214 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.requestlog [None req-b7ce2fea-ce05-4e1a-be7e-31fe9016ba90 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001703 Aug 12 01:21:06.084725 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: [pid: 105519|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 931 bytes} [Fri Aug 12 01:21:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:21:06.096883 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG dbcounter [-] [105520] Writing DB stats nova_api:SELECT=3 {{(pid=105520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:21:06.098004 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG dbcounter [-] [105520] Writing DB stats nova_cell0:SELECT=3 {{(pid=105520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:21:06.098911 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG dbcounter [-] [105520] Writing DB stats nova_cell1:SELECT=3 {{(pid=105520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:21:06.100105 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG dbcounter [-] [105520] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:21:06.932538 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-2f24070b-a4bc-47bc-995f-c1ad7b90ffe1 admin admin] Calling method '>' {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:21:06.968405 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.requestlog [None req-2f24070b-a4bc-47bc-995f-c1ad7b90ffe1 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.876747 Aug 12 01:21:06.969362 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: [pid: 105520|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1292 bytes} [Fri Aug 12 01:21:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:21:09.307399 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-b7ce2fea-ce05-4e1a-be7e-31fe9016ba90 None None] Calling method '>' {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:21:09.308861 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.requestlog [None req-b7ce2fea-ce05-4e1a-be7e-31fe9016ba90 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002142 Aug 12 01:21:09.309796 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: [pid: 105519|app: 0|req: 3/4] 10.222.0.20 () {54 vars in 931 bytes} [Fri Aug 12 01:21:09 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:21:09.742469 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-fb6f5411-2c18-4f0c-9611-a74f74c21965 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "cirros256", "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "swap": 0, "ram": 256, "os-flavor-access:is_public": true}} {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:21:09.762875 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 01:21:09.762875 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: warnings.warn(msg) Aug 12 01:21:09.791621 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.requestlog [None req-fb6f5411-2c18-4f0c-9611-a74f74c21965 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.475451 Aug 12 01:21:09.792324 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: [pid: 105520|app: 0|req: 2/5] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Aug 12 01:21:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 01:21:10.005924 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-35080113-0899-48ad-aa26-014aed970e71 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:21:10.010324 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 01:21:10.010324 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: warnings.warn(msg) Aug 12 01:21:10.031917 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG dbcounter [-] [105519] Writing DB stats nova_api:SELECT=3 {{(pid=105519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:21:10.031917 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG dbcounter [-] [105519] Writing DB stats nova_cell0:SELECT=3 {{(pid=105519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:21:10.031917 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG dbcounter [-] [105519] Writing DB stats nova_cell1:SELECT=3 {{(pid=105519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:21:10.033231 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG dbcounter [-] [105519] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:21:10.077769 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.requestlog [None req-35080113-0899-48ad-aa26-014aed970e71 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.276972 Aug 12 01:21:10.078602 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: [pid: 105519|app: 0|req: 4/6] 10.222.0.20 () {64 vars in 1336 bytes} [Fri Aug 12 01:21:09 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:21:12.390316 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-fb6f5411-2c18-4f0c-9611-a74f74c21965 admin admin] Calling method '>' {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:21:12.391326 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.requestlog [None req-fb6f5411-2c18-4f0c-9611-a74f74c21965 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 12 01:21:12.391774 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: [pid: 105520|app: 0|req: 3/7] 10.222.0.20 () {54 vars in 931 bytes} [Fri Aug 12 01:21:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 01:21:13.080338 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-9c2f8067-05f8-4fb8-81da-097f8e82fb64 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "name": "ds512M", "disk": 5, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512}} {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:21:13.099504 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 01:21:13.099504 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: warnings.warn(msg) Aug 12 01:21:13.119314 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.requestlog [None req-9c2f8067-05f8-4fb8-81da-097f8e82fb64 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.721368 Aug 12 01:21:13.120028 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: [pid: 105519|app: 0|req: 5/8] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Aug 12 01:21:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 12 01:21:13.132457 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-c279bb52-b509-481e-81c6-30acc1230759 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:21:13.135239 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 01:21:13.135239 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: warnings.warn(msg) Aug 12 01:21:13.168482 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.requestlog [None req-c279bb52-b509-481e-81c6-30acc1230759 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039625 Aug 12 01:21:13.175708 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: [pid: 105520|app: 0|req: 4/9] 10.222.0.20 () {64 vars in 1336 bytes} [Fri Aug 12 01:21:13 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:21:15.533066 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-9c2f8067-05f8-4fb8-81da-097f8e82fb64 admin admin] Calling method '>' {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:21:15.534146 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.requestlog [None req-9c2f8067-05f8-4fb8-81da-097f8e82fb64 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Aug 12 01:21:15.534619 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: [pid: 105519|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 931 bytes} [Fri Aug 12 01:21:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:21:15.950246 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-62e7de2d-de25-4426-82ba-ac087d53a4cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "id": "d2", "disk": 10, "name": "ds1G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:21:15.969339 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.requestlog [None req-62e7de2d-de25-4426-82ba-ac087d53a4cd admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.428291 Aug 12 01:21:15.970026 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: [pid: 105520|app: 0|req: 5/11] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Aug 12 01:21:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 01:21:15.982205 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-1a7db68d-ce24-4938-bad1-d6d709ff2a7f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:21:16.005535 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.requestlog [None req-1a7db68d-ce24-4938-bad1-d6d709ff2a7f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027189 Aug 12 01:21:16.006176 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: [pid: 105519|app: 0|req: 7/12] 10.222.0.20 () {64 vars in 1336 bytes} [Fri Aug 12 01:21:15 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:21:18.308548 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-62e7de2d-de25-4426-82ba-ac087d53a4cd admin admin] Calling method '>' {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:21:18.309543 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.requestlog [None req-62e7de2d-de25-4426-82ba-ac087d53a4cd admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 12 01:21:18.309966 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: [pid: 105520|app: 0|req: 6/13] 10.222.0.20 () {54 vars in 931 bytes} [Fri Aug 12 01:21:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:21:18.785260 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-b0513ca2-7a3a-4c83-b8bd-bd161068f636 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "swap": 0, "ram": 2048, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G"}} {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:21:18.806865 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.requestlog [None req-b0513ca2-7a3a-4c83-b8bd-bd161068f636 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.485092 Aug 12 01:21:18.807381 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: [pid: 105519|app: 0|req: 8/14] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Aug 12 01:21:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 01:21:18.820188 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-a8dd188d-f601-4b8d-8b5f-d11ea491abc2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:21:18.847307 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.requestlog [None req-a8dd188d-f601-4b8d-8b5f-d11ea491abc2 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030639 Aug 12 01:21:18.848187 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: [pid: 105520|app: 0|req: 7/15] 10.222.0.20 () {64 vars in 1336 bytes} [Fri Aug 12 01:21:18 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:21:21.185871 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-b0513ca2-7a3a-4c83-b8bd-bd161068f636 admin admin] Calling method '>' {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:21:21.187560 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.requestlog [None req-b0513ca2-7a3a-4c83-b8bd-bd161068f636 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002183 Aug 12 01:21:21.188151 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: [pid: 105519|app: 0|req: 9/16] 10.222.0.20 () {54 vars in 931 bytes} [Fri Aug 12 01:21:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:21:21.612009 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-13710ff0-c30e-42e4-bf16-ce3108c9adf5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4, "ram": 4096, "os-flavor-access:is_public": true, "name": "ds4G", "id": "d4", "disk": 20}} {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:21:21.635033 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.requestlog [None req-13710ff0-c30e-42e4-bf16-ce3108c9adf5 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.439770 Aug 12 01:21:21.635829 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: [pid: 105520|app: 0|req: 8/17] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Aug 12 01:21:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 01:21:21.647956 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-26c006d4-bfd8-4456-9c17-1a380fd83b8d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:21:21.677067 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.requestlog [None req-26c006d4-bfd8-4456-9c17-1a380fd83b8d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032746 Aug 12 01:21:21.677641 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: [pid: 105519|app: 0|req: 10/18] 10.222.0.20 () {64 vars in 1336 bytes} [Fri Aug 12 01:21:21 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:21:23.986632 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-13710ff0-c30e-42e4-bf16-ce3108c9adf5 admin admin] Calling method '>' {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:21:23.987649 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.requestlog [None req-13710ff0-c30e-42e4-bf16-ce3108c9adf5 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 12 01:21:23.988051 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: [pid: 105520|app: 0|req: 9/19] 10.222.0.20 () {54 vars in 931 bytes} [Fri Aug 12 01:21:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 01:21:24.461571 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-a712f0a9-ab84-4610-8300-ec3784ebd66b admin admin] Calling method '>' {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:21:24.486235 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.requestlog [None req-a712f0a9-ab84-4610-8300-ec3784ebd66b admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.491932 Aug 12 01:21:24.486745 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: [pid: 105519|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1292 bytes} [Fri Aug 12 01:21:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:21:27.062470 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-13710ff0-c30e-42e4-bf16-ce3108c9adf5 admin admin] Calling method '>' {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:21:27.063860 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.requestlog [None req-13710ff0-c30e-42e4-bf16-ce3108c9adf5 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001972 Aug 12 01:21:27.064312 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: [pid: 105520|app: 0|req: 10/21] 10.222.0.20 () {54 vars in 931 bytes} [Fri Aug 12 01:21:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:21:27.500678 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-5879d7d5-5039-4dd2-b73d-0457ebb8439b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "ram": 512, "disk": 1, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:21:27.522251 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.requestlog [None req-5879d7d5-5039-4dd2-b73d-0457ebb8439b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.450174 Aug 12 01:21:27.522795 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: [pid: 105519|app: 0|req: 12/22] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Aug 12 01:21:27 2022] POST /compute/v2.1/flavors => generated 402 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 01:21:27.538682 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-3b2dc6fd-624b-4353-a152-4467b4cc59b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:21:27.568486 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.requestlog [None req-3b2dc6fd-624b-4353-a152-4467b4cc59b2 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034842 Aug 12 01:21:27.569076 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: [pid: 105520|app: 0|req: 11/23] 10.222.0.20 () {64 vars in 1333 bytes} [Fri Aug 12 01:21:27 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:21:29.919655 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-5879d7d5-5039-4dd2-b73d-0457ebb8439b admin admin] Calling method '>' {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:21:29.920575 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.requestlog [None req-5879d7d5-5039-4dd2-b73d-0457ebb8439b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Aug 12 01:21:29.920974 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: [pid: 105519|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 931 bytes} [Fri Aug 12 01:21:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:21:30.328780 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-441e4118-2864-42f9-a89a-4371c7772169 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 20, "ram": 2048, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "rxtx_factor": 1.0, "vcpus": 1, "name": "m1.small"}} {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:21:30.348752 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.requestlog [None req-441e4118-2864-42f9-a89a-4371c7772169 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.421520 Aug 12 01:21:30.349273 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: [pid: 105520|app: 0|req: 12/25] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Aug 12 01:21:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 12 01:21:30.361373 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-28b23c07-931a-403a-a499-d8ba841bd40d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:21:30.386114 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.requestlog [None req-28b23c07-931a-403a-a499-d8ba841bd40d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028467 Aug 12 01:21:30.386801 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: [pid: 105519|app: 0|req: 14/26] 10.222.0.20 () {64 vars in 1333 bytes} [Fri Aug 12 01:21:30 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:21:32.754320 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-441e4118-2864-42f9-a89a-4371c7772169 admin admin] Calling method '>' {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:21:32.756136 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.requestlog [None req-441e4118-2864-42f9-a89a-4371c7772169 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002262 Aug 12 01:21:32.757020 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: [pid: 105520|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 931 bytes} [Fri Aug 12 01:21:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:21:33.217978 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-babf13a0-1d9e-4bbe-8352-a88a08235aab admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.medium", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40}} {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:21:33.239664 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.requestlog [None req-babf13a0-1d9e-4bbe-8352-a88a08235aab admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.476682 Aug 12 01:21:33.247631 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: [pid: 105519|app: 0|req: 15/28] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Aug 12 01:21:32 2022] POST /compute/v2.1/flavors => generated 406 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 01:21:33.252533 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-b9699c13-74e0-4b8c-a6bb-3f5af73186fe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:21:33.280263 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.requestlog [None req-b9699c13-74e0-4b8c-a6bb-3f5af73186fe admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031439 Aug 12 01:21:33.280943 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: [pid: 105520|app: 0|req: 14/29] 10.222.0.20 () {64 vars in 1333 bytes} [Fri Aug 12 01:21:33 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:21:35.627898 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-babf13a0-1d9e-4bbe-8352-a88a08235aab admin admin] Calling method '>' {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:21:35.629549 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.requestlog [None req-babf13a0-1d9e-4bbe-8352-a88a08235aab admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002140 Aug 12 01:21:35.631907 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: [pid: 105519|app: 0|req: 16/30] 10.222.0.20 () {54 vars in 931 bytes} [Fri Aug 12 01:21:35 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:21:36.061945 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-9c557c83-f764-4042-8b14-e29a3cc442a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "4", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "disk": 80, "ram": 8192, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:21:36.086482 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.requestlog [None req-9c557c83-f764-4042-8b14-e29a3cc442a9 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.450356 Aug 12 01:21:36.087641 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: [pid: 105520|app: 0|req: 15/31] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Aug 12 01:21:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 01:21:36.099652 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-76b9c7c2-7ceb-4ed0-bf7a-5f7279d32b15 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:21:36.125615 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.requestlog [None req-76b9c7c2-7ceb-4ed0-bf7a-5f7279d32b15 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029618 Aug 12 01:21:36.126189 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: [pid: 105519|app: 0|req: 17/32] 10.222.0.20 () {64 vars in 1333 bytes} [Fri Aug 12 01:21:36 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:21:38.480958 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-9c557c83-f764-4042-8b14-e29a3cc442a9 admin admin] Calling method '>' {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:21:38.481977 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.requestlog [None req-9c557c83-f764-4042-8b14-e29a3cc442a9 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 12 01:21:38.482603 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: [pid: 105520|app: 0|req: 16/33] 10.222.0.20 () {54 vars in 931 bytes} [Fri Aug 12 01:21:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:21:38.925760 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-c0563118-b450-4f7c-bad2-7115890728b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "name": "m1.xlarge", "id": "5", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "ram": 16384}} {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:21:38.950849 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.requestlog [None req-c0563118-b450-4f7c-bad2-7115890728b0 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.462092 Aug 12 01:21:38.951394 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: [pid: 105519|app: 0|req: 18/34] 10.222.0.20 () {64 vars in 1283 bytes} [Fri Aug 12 01:21:38 2022] POST /compute/v2.1/flavors => generated 408 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 01:21:38.963450 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-236172f1-534b-4693-b0ac-4780ae606486 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:21:38.969682 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG dbcounter [-] [105520] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:21:38.992646 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.requestlog [None req-236172f1-534b-4693-b0ac-4780ae606486 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032773 Aug 12 01:21:38.993251 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: [pid: 105520|app: 0|req: 17/35] 10.222.0.20 () {64 vars in 1333 bytes} [Fri Aug 12 01:21:38 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:21:57.387943 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-c0563118-b450-4f7c-bad2-7115890728b0 admin admin] Calling method '>' {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:21:57.389047 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.requestlog [None req-c0563118-b450-4f7c-bad2-7115890728b0 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Aug 12 01:21:57.389510 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: [pid: 105519|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 931 bytes} [Fri Aug 12 01:21:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:21:57.790641 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-4311f997-eca3-474b-89d9-90f01533a7ff admin admin] Calling method '>' {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:21:57.808984 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.requestlog [None req-4311f997-eca3-474b-89d9-90f01533a7ff admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.413149 Aug 12 01:21:57.809505 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: [pid: 105520|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1292 bytes} [Fri Aug 12 01:21:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:21:58.862265 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-c0563118-b450-4f7c-bad2-7115890728b0 admin admin] Calling method '>' {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:21:58.863267 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.requestlog [None req-c0563118-b450-4f7c-bad2-7115890728b0 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 12 01:21:58.863711 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: [pid: 105519|app: 0|req: 20/38] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Aug 12 01:21:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:21:59.435030 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-0acea712-066d-42d1-840e-e91f514301a2 admin admin] Calling method '>' {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:21:59.441094 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.wsgi [None req-0acea712-066d-42d1-840e-e91f514301a2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 12 01:21:59.444557 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-0acea712-066d-42d1-840e-e91f514301a2 admin admin] Request method failure captured: Aug 12 01:21:59.444557 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 12 01:21:59.444557 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: Accept: application/json Aug 12 01:21:59.444557 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: Accept-Encoding: gzip, deflate Aug 12 01:21:59.444557 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: Connection: keep-alive Aug 12 01:21:59.444557 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: Content-Length: 0 Aug 12 01:21:59.444557 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: Host: 10.222.0.20 Aug 12 01:21:59.444557 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: Openstack-Api-Version: compute 2.90 Aug 12 01:21:59.444557 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: Openstack-System-Scope: None Aug 12 01:21:59.444557 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: User-Agent: python-novaclient Aug 12 01:21:59.444557 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Auth-Token: gAAAAABi9as2gI6IFgleNZc3NnE5EzBxivuZ1AV_yknIXcE91pDcxfbmWdLClaTrubilwkNsXRzEdYhctw7WGu1jCrDUBMkPnEtoTFo7b7kuEBEtvawjtOnDBPRk8srg5eB7h9_2N9ESIiWmzfMGe-NdwM4rB1nxaCTkLEdnBIg_p-BllvdlVB4 Aug 12 01:21:59.444557 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Domain-Id: None Aug 12 01:21:59.444557 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Domain-Name: None Aug 12 01:21:59.444557 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Identity-Status: Confirmed Aug 12 01:21:59.444557 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Is-Admin-Project: True Aug 12 01:21:59.444557 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Openstack-Nova-Api-Version: 2.90 Aug 12 01:21:59.444557 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Project-Domain-Id: default Aug 12 01:21:59.444557 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Project-Domain-Name: Default Aug 12 01:21:59.444557 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Project-Id: c77071b47cbd4a83bfd54874694bd940 Aug 12 01:21:59.444557 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Project-Name: admin Aug 12 01:21:59.444557 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Role: admin,member,reader Aug 12 01:21:59.444557 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Roles: admin,member,reader Aug 12 01:21:59.446170 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c77071b47cbd4a83bfd54874694bd940"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c77071b47cbd4a83bfd54874694bd940"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c77071b47cbd4a83bfd54874694bd940"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c77071b47cbd4a83bfd54874694bd940"}]}] Aug 12 01:21:59.446170 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Tenant: admin Aug 12 01:21:59.446170 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Tenant-Id: c77071b47cbd4a83bfd54874694bd940 Aug 12 01:21:59.446170 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Tenant-Name: admin Aug 12 01:21:59.446170 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-User: admin Aug 12 01:21:59.446170 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-User-Domain-Id: default Aug 12 01:21:59.446170 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-User-Domain-Name: Default Aug 12 01:21:59.446170 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-User-Id: 1ece3467c3f542a1b55493e0e53752eb Aug 12 01:21:59.446170 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-User-Name: admin Aug 12 01:21:59.446170 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: method: > Aug 12 01:21:59.446170 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: exception: Flavor 42 could not be found. Aug 12 01:21:59.446170 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: action_args: {'id': '42'} Aug 12 01:21:59.446170 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:21:59.446170 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:21:59.447184 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 12 01:21:59.447184 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 12 01:21:59.447184 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 12 01:21:59.447184 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 12 01:21:59.447184 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 12 01:21:59.447184 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 12 01:21:59.447184 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 12 01:21:59.447184 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 12 01:21:59.447184 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 12 01:21:59.447184 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:21:59.447184 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 12 01:21:59.447184 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 12 01:21:59.447184 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 12 01:21:59.447184 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi Aug 12 01:21:59.447184 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:21:59.447184 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi Aug 12 01:21:59.447184 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:21:59.447184 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:21:59.447184 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:21:59.448340 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:21:59.448340 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:21:59.448340 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:21:59.448340 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:21:59.448340 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 12 01:21:59.448340 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:21:59.448340 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 12 01:21:59.448340 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi Aug 12 01:21:59.448340 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:21:59.448340 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi Aug 12 01:21:59.448340 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:21:59.448340 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:21:59.448340 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:21:59.448340 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:21:59.448340 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:21:59.448340 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 12 01:21:59.448340 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi Aug 12 01:21:59.448340 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-0acea712-066d-42d1-840e-e91f514301a2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:21:59.449406 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.requestlog [None req-0acea712-066d-42d1-840e-e91f514301a2 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.439828 Aug 12 01:21:59.449406 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: [pid: 105520|app: 0|req: 19/39] 10.222.0.20 () {60 vars in 1190 bytes} [Fri Aug 12 01:21:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 441 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 12 01:21:59.456153 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-7707b239-0405-411a-8a60-f67a3ed60513 admin admin] Calling method '>' {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:21:59.460272 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG dbcounter [-] [105519] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:21:59.478798 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.requestlog [None req-7707b239-0405-411a-8a60-f67a3ed60513 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026244 Aug 12 01:21:59.479341 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: [pid: 105519|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Aug 12 01:21:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:21:59.492327 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-94adf445-97d3-4e9c-bf45-605e470036bb admin admin] Calling method '>' {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:21:59.524122 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.requestlog [None req-94adf445-97d3-4e9c-bf45-605e470036bb admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.038042 Aug 12 01:21:59.524684 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: [pid: 105520|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Aug 12 01:21:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:21:59.534358 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-f93fd1ac-20f2-46b4-88e6-10b976bb878b admin admin] Calling method '>' {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:21:59.540584 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.wsgi [None req-f93fd1ac-20f2-46b4-88e6-10b976bb878b admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 12 01:21:59.543910 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-f93fd1ac-20f2-46b4-88e6-10b976bb878b admin admin] Request method failure captured: Aug 12 01:21:59.543910 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 12 01:21:59.543910 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: Accept: application/json Aug 12 01:21:59.543910 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: Accept-Encoding: gzip, deflate Aug 12 01:21:59.543910 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: Connection: keep-alive Aug 12 01:21:59.543910 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: Content-Length: 0 Aug 12 01:21:59.543910 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: Host: 10.222.0.20 Aug 12 01:21:59.543910 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: Openstack-Api-Version: compute 2.90 Aug 12 01:21:59.543910 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: Openstack-System-Scope: None Aug 12 01:21:59.543910 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: User-Agent: python-novaclient Aug 12 01:21:59.543910 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Auth-Token: gAAAAABi9as2gI6IFgleNZc3NnE5EzBxivuZ1AV_yknIXcE91pDcxfbmWdLClaTrubilwkNsXRzEdYhctw7WGu1jCrDUBMkPnEtoTFo7b7kuEBEtvawjtOnDBPRk8srg5eB7h9_2N9ESIiWmzfMGe-NdwM4rB1nxaCTkLEdnBIg_p-BllvdlVB4 Aug 12 01:21:59.543910 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Domain-Id: None Aug 12 01:21:59.543910 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Domain-Name: None Aug 12 01:21:59.543910 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Identity-Status: Confirmed Aug 12 01:21:59.543910 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Is-Admin-Project: True Aug 12 01:21:59.543910 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Openstack-Nova-Api-Version: 2.90 Aug 12 01:21:59.543910 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Project-Domain-Id: default Aug 12 01:21:59.543910 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Project-Domain-Name: Default Aug 12 01:21:59.543910 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Project-Id: c77071b47cbd4a83bfd54874694bd940 Aug 12 01:21:59.543910 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Project-Name: admin Aug 12 01:21:59.543910 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Role: admin,member,reader Aug 12 01:21:59.543910 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Roles: admin,member,reader Aug 12 01:21:59.545487 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c77071b47cbd4a83bfd54874694bd940"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c77071b47cbd4a83bfd54874694bd940"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c77071b47cbd4a83bfd54874694bd940"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c77071b47cbd4a83bfd54874694bd940"}]}] Aug 12 01:21:59.545487 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Tenant: admin Aug 12 01:21:59.545487 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Tenant-Id: c77071b47cbd4a83bfd54874694bd940 Aug 12 01:21:59.545487 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Tenant-Name: admin Aug 12 01:21:59.545487 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-User: admin Aug 12 01:21:59.545487 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-User-Domain-Id: default Aug 12 01:21:59.545487 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-User-Domain-Name: Default Aug 12 01:21:59.545487 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-User-Id: 1ece3467c3f542a1b55493e0e53752eb Aug 12 01:21:59.545487 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-User-Name: admin Aug 12 01:21:59.545487 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: method: > Aug 12 01:21:59.545487 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: exception: Flavor 42 could not be found. Aug 12 01:21:59.545487 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: action_args: {'id': '42'} Aug 12 01:21:59.545487 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:21:59.545487 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:21:59.546356 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 12 01:21:59.546356 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 12 01:21:59.546356 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 12 01:21:59.546356 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 12 01:21:59.546356 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 12 01:21:59.546356 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 12 01:21:59.546356 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 12 01:21:59.546356 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 12 01:21:59.546356 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 12 01:21:59.546356 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:21:59.546356 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 12 01:21:59.546356 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 12 01:21:59.546356 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 12 01:21:59.546356 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi Aug 12 01:21:59.546356 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:21:59.546356 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi Aug 12 01:21:59.546356 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:21:59.546356 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:21:59.546356 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:21:59.547402 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:21:59.547402 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:21:59.547402 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:21:59.547402 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:21:59.547402 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 12 01:21:59.547402 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:21:59.547402 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 12 01:21:59.547402 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi Aug 12 01:21:59.547402 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:21:59.547402 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi Aug 12 01:21:59.547402 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:21:59.547402 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:21:59.547402 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:21:59.547402 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:21:59.547402 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:21:59.547402 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 12 01:21:59.547402 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi Aug 12 01:21:59.547402 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-f93fd1ac-20f2-46b4-88e6-10b976bb878b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:21:59.548757 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.requestlog [None req-f93fd1ac-20f2-46b4-88e6-10b976bb878b admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014600 Aug 12 01:21:59.548757 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: [pid: 105519|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1190 bytes} [Fri Aug 12 01:21:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 12 01:22:00.519031 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-94adf445-97d3-4e9c-bf45-605e470036bb admin admin] Calling method '>' {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:22:00.520700 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.requestlog [None req-94adf445-97d3-4e9c-bf45-605e470036bb admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002045 Aug 12 01:22:00.521256 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: [pid: 105520|app: 0|req: 21/43] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Aug 12 01:22:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:22:01.075647 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-8501705d-a5e3-4255-a50a-78a4f4cde95a admin admin] Calling method '>' {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:22:01.081144 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.wsgi [None req-8501705d-a5e3-4255-a50a-78a4f4cde95a admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 12 01:22:01.082651 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-8501705d-a5e3-4255-a50a-78a4f4cde95a admin admin] Request method failure captured: Aug 12 01:22:01.082651 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 12 01:22:01.082651 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: Accept: application/json Aug 12 01:22:01.082651 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: Accept-Encoding: gzip, deflate Aug 12 01:22:01.082651 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: Connection: keep-alive Aug 12 01:22:01.082651 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: Content-Length: 0 Aug 12 01:22:01.082651 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: Host: 10.222.0.20 Aug 12 01:22:01.082651 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: Openstack-Api-Version: compute 2.90 Aug 12 01:22:01.082651 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: Openstack-System-Scope: None Aug 12 01:22:01.082651 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: User-Agent: python-novaclient Aug 12 01:22:01.082651 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Auth-Token: gAAAAABi9as4N1y7ki9Xnsv7Fw-9mIM7UjLm4ww728BWF9wfIE09IzPvSs_Ft54ZmsETDSPkAukL3mvm2HCAthez5DZ93av9rDkp5vdAoLK1dkMmNgQEtsZnEUohPWQI5oQwwPYVswpPiyu5bqTZPinrSeCiqqh3u5JUuCMW-9HqjGWWtFb0P9U Aug 12 01:22:01.082651 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Domain-Id: None Aug 12 01:22:01.082651 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Domain-Name: None Aug 12 01:22:01.082651 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Identity-Status: Confirmed Aug 12 01:22:01.082651 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Is-Admin-Project: True Aug 12 01:22:01.082651 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Openstack-Nova-Api-Version: 2.90 Aug 12 01:22:01.082651 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Project-Domain-Id: default Aug 12 01:22:01.082651 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Project-Domain-Name: Default Aug 12 01:22:01.082651 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Project-Id: c77071b47cbd4a83bfd54874694bd940 Aug 12 01:22:01.082651 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Project-Name: admin Aug 12 01:22:01.082651 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Role: admin,member,reader Aug 12 01:22:01.082651 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Roles: admin,member,reader Aug 12 01:22:01.084213 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c77071b47cbd4a83bfd54874694bd940"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c77071b47cbd4a83bfd54874694bd940"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c77071b47cbd4a83bfd54874694bd940"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c77071b47cbd4a83bfd54874694bd940"}]}] Aug 12 01:22:01.084213 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Tenant: admin Aug 12 01:22:01.084213 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Tenant-Id: c77071b47cbd4a83bfd54874694bd940 Aug 12 01:22:01.084213 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Tenant-Name: admin Aug 12 01:22:01.084213 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-User: admin Aug 12 01:22:01.084213 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-User-Domain-Id: default Aug 12 01:22:01.084213 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-User-Domain-Name: Default Aug 12 01:22:01.084213 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-User-Id: 1ece3467c3f542a1b55493e0e53752eb Aug 12 01:22:01.084213 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-User-Name: admin Aug 12 01:22:01.084213 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: method: > Aug 12 01:22:01.084213 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: exception: Flavor 84 could not be found. Aug 12 01:22:01.084213 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: action_args: {'id': '84'} Aug 12 01:22:01.084213 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:22:01.084213 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:22:01.085114 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 12 01:22:01.085114 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 12 01:22:01.085114 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 12 01:22:01.085114 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 12 01:22:01.085114 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 12 01:22:01.085114 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 12 01:22:01.085114 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 12 01:22:01.085114 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 12 01:22:01.085114 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 12 01:22:01.085114 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:22:01.085114 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 12 01:22:01.085114 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 12 01:22:01.085114 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 12 01:22:01.085114 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi Aug 12 01:22:01.085114 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:22:01.085114 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi Aug 12 01:22:01.085114 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:22:01.085114 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:22:01.085114 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:22:01.086191 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:22:01.086191 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:22:01.086191 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:22:01.086191 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:22:01.086191 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 12 01:22:01.086191 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:22:01.086191 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 12 01:22:01.086191 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi Aug 12 01:22:01.086191 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:22:01.086191 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi Aug 12 01:22:01.086191 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:22:01.086191 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:22:01.086191 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:22:01.086191 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:22:01.086191 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:22:01.086191 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 12 01:22:01.086191 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi Aug 12 01:22:01.086191 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-8501705d-a5e3-4255-a50a-78a4f4cde95a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:22:01.087197 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.requestlog [None req-8501705d-a5e3-4255-a50a-78a4f4cde95a admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.426844 Aug 12 01:22:01.087197 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: [pid: 105519|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1190 bytes} [Fri Aug 12 01:22:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 428 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 12 01:22:01.096134 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-be274c0e-6058-43c8-8606-206a050a417c admin admin] Calling method '>' {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:22:01.115248 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.requestlog [None req-be274c0e-6058-43c8-8606-206a050a417c admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024495 Aug 12 01:22:01.115829 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: [pid: 105520|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Aug 12 01:22:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:22:01.128371 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-22bd39bf-8b21-4e37-a703-a7ab8e8b1c6a admin admin] Calling method '>' {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:22:01.148432 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.requestlog [None req-22bd39bf-8b21-4e37-a703-a7ab8e8b1c6a admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025962 Aug 12 01:22:01.148961 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: [pid: 105519|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Aug 12 01:22:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:22:01.158403 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-f34fc681-3b85-4d98-bfbc-b9a0615eb26a admin admin] Calling method '>' {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:22:01.164020 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.wsgi [None req-f34fc681-3b85-4d98-bfbc-b9a0615eb26a admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 12 01:22:01.165532 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-f34fc681-3b85-4d98-bfbc-b9a0615eb26a admin admin] Request method failure captured: Aug 12 01:22:01.165532 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 12 01:22:01.165532 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: Accept: application/json Aug 12 01:22:01.165532 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: Accept-Encoding: gzip, deflate Aug 12 01:22:01.165532 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: Connection: keep-alive Aug 12 01:22:01.165532 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: Content-Length: 0 Aug 12 01:22:01.165532 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: Host: 10.222.0.20 Aug 12 01:22:01.165532 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: Openstack-Api-Version: compute 2.90 Aug 12 01:22:01.165532 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: Openstack-System-Scope: None Aug 12 01:22:01.165532 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: User-Agent: python-novaclient Aug 12 01:22:01.165532 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Auth-Token: gAAAAABi9as4N1y7ki9Xnsv7Fw-9mIM7UjLm4ww728BWF9wfIE09IzPvSs_Ft54ZmsETDSPkAukL3mvm2HCAthez5DZ93av9rDkp5vdAoLK1dkMmNgQEtsZnEUohPWQI5oQwwPYVswpPiyu5bqTZPinrSeCiqqh3u5JUuCMW-9HqjGWWtFb0P9U Aug 12 01:22:01.165532 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Domain-Id: None Aug 12 01:22:01.165532 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Domain-Name: None Aug 12 01:22:01.165532 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Identity-Status: Confirmed Aug 12 01:22:01.165532 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Is-Admin-Project: True Aug 12 01:22:01.165532 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Openstack-Nova-Api-Version: 2.90 Aug 12 01:22:01.165532 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Project-Domain-Id: default Aug 12 01:22:01.165532 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Project-Domain-Name: Default Aug 12 01:22:01.165532 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Project-Id: c77071b47cbd4a83bfd54874694bd940 Aug 12 01:22:01.165532 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Project-Name: admin Aug 12 01:22:01.165532 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Role: admin,member,reader Aug 12 01:22:01.165532 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Roles: admin,member,reader Aug 12 01:22:01.167130 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c77071b47cbd4a83bfd54874694bd940"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c77071b47cbd4a83bfd54874694bd940"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c77071b47cbd4a83bfd54874694bd940"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c77071b47cbd4a83bfd54874694bd940"}]}] Aug 12 01:22:01.167130 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Tenant: admin Aug 12 01:22:01.167130 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Tenant-Id: c77071b47cbd4a83bfd54874694bd940 Aug 12 01:22:01.167130 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Tenant-Name: admin Aug 12 01:22:01.167130 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-User: admin Aug 12 01:22:01.167130 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-User-Domain-Id: default Aug 12 01:22:01.167130 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-User-Domain-Name: Default Aug 12 01:22:01.167130 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-User-Id: 1ece3467c3f542a1b55493e0e53752eb Aug 12 01:22:01.167130 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-User-Name: admin Aug 12 01:22:01.167130 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: method: > Aug 12 01:22:01.167130 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: exception: Flavor 84 could not be found. Aug 12 01:22:01.167130 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: action_args: {'id': '84'} Aug 12 01:22:01.167130 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:22:01.167130 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:22:01.168266 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 12 01:22:01.168266 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 12 01:22:01.168266 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 12 01:22:01.168266 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 12 01:22:01.168266 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 12 01:22:01.168266 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 12 01:22:01.168266 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 12 01:22:01.168266 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 12 01:22:01.168266 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 12 01:22:01.168266 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:22:01.168266 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 12 01:22:01.168266 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 12 01:22:01.168266 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 12 01:22:01.168266 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi Aug 12 01:22:01.168266 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:22:01.168266 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi Aug 12 01:22:01.168266 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:22:01.168266 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:22:01.168266 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:22:01.169787 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:22:01.169787 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:22:01.169787 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:22:01.169787 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:22:01.169787 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 12 01:22:01.169787 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:22:01.169787 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 12 01:22:01.169787 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi Aug 12 01:22:01.169787 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:22:01.169787 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi Aug 12 01:22:01.169787 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:22:01.169787 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:22:01.169787 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:22:01.169787 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:22:01.169787 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:22:01.169787 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 12 01:22:01.169787 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi Aug 12 01:22:01.169787 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-f34fc681-3b85-4d98-bfbc-b9a0615eb26a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:22:01.171080 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.requestlog [None req-f34fc681-3b85-4d98-bfbc-b9a0615eb26a admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012110 Aug 12 01:22:01.171080 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: [pid: 105520|app: 0|req: 23/47] 10.222.0.20 () {60 vars in 1190 bytes} [Fri Aug 12 01:22:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 12 01:22:02.153673 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-22bd39bf-8b21-4e37-a703-a7ab8e8b1c6a admin admin] Calling method '>' {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:22:02.155070 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.requestlog [None req-22bd39bf-8b21-4e37-a703-a7ab8e8b1c6a admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002015 Aug 12 01:22:02.155581 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: [pid: 105519|app: 0|req: 25/48] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Aug 12 01:22:02 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:22:02.724440 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-c9cc8b38-c934-4329-85f2-4e99962e32c4 admin admin] Calling method '>' {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:22:02.730252 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.wsgi [None req-c9cc8b38-c934-4329-85f2-4e99962e32c4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 12 01:22:02.731763 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-c9cc8b38-c934-4329-85f2-4e99962e32c4 admin admin] Request method failure captured: Aug 12 01:22:02.731763 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 12 01:22:02.731763 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: Accept: application/json Aug 12 01:22:02.731763 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: Accept-Encoding: gzip, deflate Aug 12 01:22:02.731763 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: Connection: keep-alive Aug 12 01:22:02.731763 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: Content-Length: 0 Aug 12 01:22:02.731763 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: Host: 10.222.0.20 Aug 12 01:22:02.731763 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: Openstack-Api-Version: compute 2.90 Aug 12 01:22:02.731763 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: Openstack-System-Scope: None Aug 12 01:22:02.731763 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: User-Agent: python-novaclient Aug 12 01:22:02.731763 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Auth-Token: gAAAAABi9as6Wy-WpJ0ubjTQrA_VYV0bCDNVMnhy6zP9BvJ3WeXJHNGLQ61zHQy5bRnhrzl4DZsua97HcMuc-naPzdTXg7VJNbHTqr-O8u-cX7KYjMbtoqPom7dQafbgOb1yATLXJwYYrShx_B78LtfsZmKYx3TW_RURAWt05_xT9OSvk6BPM2M Aug 12 01:22:02.731763 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Domain-Id: None Aug 12 01:22:02.731763 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Domain-Name: None Aug 12 01:22:02.731763 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Identity-Status: Confirmed Aug 12 01:22:02.731763 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Is-Admin-Project: True Aug 12 01:22:02.731763 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Openstack-Nova-Api-Version: 2.90 Aug 12 01:22:02.731763 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Project-Domain-Id: default Aug 12 01:22:02.731763 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Project-Domain-Name: Default Aug 12 01:22:02.731763 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Project-Id: c77071b47cbd4a83bfd54874694bd940 Aug 12 01:22:02.731763 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Project-Name: admin Aug 12 01:22:02.731763 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Role: admin,member,reader Aug 12 01:22:02.731763 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Roles: admin,member,reader Aug 12 01:22:02.733328 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c77071b47cbd4a83bfd54874694bd940"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c77071b47cbd4a83bfd54874694bd940"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c77071b47cbd4a83bfd54874694bd940"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c77071b47cbd4a83bfd54874694bd940"}]}] Aug 12 01:22:02.733328 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Tenant: admin Aug 12 01:22:02.733328 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Tenant-Id: c77071b47cbd4a83bfd54874694bd940 Aug 12 01:22:02.733328 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-Tenant-Name: admin Aug 12 01:22:02.733328 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-User: admin Aug 12 01:22:02.733328 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-User-Domain-Id: default Aug 12 01:22:02.733328 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-User-Domain-Name: Default Aug 12 01:22:02.733328 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-User-Id: 1ece3467c3f542a1b55493e0e53752eb Aug 12 01:22:02.733328 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: X-User-Name: admin Aug 12 01:22:02.733328 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: method: > Aug 12 01:22:02.733328 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: exception: Flavor 451 could not be found. Aug 12 01:22:02.733328 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: action_args: {'id': '451'} Aug 12 01:22:02.733328 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:22:02.733328 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:22:02.734232 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 12 01:22:02.734232 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 12 01:22:02.734232 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 12 01:22:02.734232 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 12 01:22:02.734232 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 12 01:22:02.734232 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 12 01:22:02.734232 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 12 01:22:02.734232 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 12 01:22:02.734232 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 12 01:22:02.734232 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:22:02.734232 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 12 01:22:02.734232 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 12 01:22:02.734232 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 12 01:22:02.734232 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi Aug 12 01:22:02.734232 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:22:02.734232 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi Aug 12 01:22:02.734232 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:22:02.734232 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:22:02.734232 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:22:02.735320 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:22:02.735320 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:22:02.735320 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:22:02.735320 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:22:02.735320 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 12 01:22:02.735320 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:22:02.735320 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 12 01:22:02.735320 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi Aug 12 01:22:02.735320 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:22:02.735320 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi Aug 12 01:22:02.735320 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:22:02.735320 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:22:02.735320 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:22:02.735320 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:22:02.735320 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:22:02.735320 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 12 01:22:02.735320 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: ERROR nova.api.openstack.wsgi Aug 12 01:22:02.735320 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-c9cc8b38-c934-4329-85f2-4e99962e32c4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:22:02.736532 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.requestlog [None req-c9cc8b38-c934-4329-85f2-4e99962e32c4 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.437789 Aug 12 01:22:02.736532 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: [pid: 105520|app: 0|req: 24/49] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Aug 12 01:22:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 439 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 12 01:22:02.743044 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-b084b12f-0914-4de2-b55e-70edcf20b151 admin admin] Calling method '>' {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:22:02.758115 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.requestlog [None req-b084b12f-0914-4de2-b55e-70edcf20b151 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018652 Aug 12 01:22:02.758627 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: [pid: 105519|app: 0|req: 26/50] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Aug 12 01:22:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:22:02.768275 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-4ef9c894-7075-4dfd-8954-95bcc6f2ebe0 admin admin] Calling method '>' {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:22:02.783334 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.requestlog [None req-4ef9c894-7075-4dfd-8954-95bcc6f2ebe0 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018669 Aug 12 01:22:02.783884 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: [pid: 105520|app: 0|req: 25/51] 10.222.0.20 () {60 vars in 1210 bytes} [Fri Aug 12 01:22:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:22:02.793158 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-f8567844-8ea1-40c6-a4cf-7dc996c213da admin admin] Calling method '>' {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:22:02.798786 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.wsgi [None req-f8567844-8ea1-40c6-a4cf-7dc996c213da admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 12 01:22:02.800324 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-f8567844-8ea1-40c6-a4cf-7dc996c213da admin admin] Request method failure captured: Aug 12 01:22:02.800324 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 12 01:22:02.800324 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: Accept: application/json Aug 12 01:22:02.800324 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: Accept-Encoding: gzip, deflate Aug 12 01:22:02.800324 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: Connection: keep-alive Aug 12 01:22:02.800324 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: Content-Length: 0 Aug 12 01:22:02.800324 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: Host: 10.222.0.20 Aug 12 01:22:02.800324 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: Openstack-Api-Version: compute 2.90 Aug 12 01:22:02.800324 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: Openstack-System-Scope: None Aug 12 01:22:02.800324 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: User-Agent: python-novaclient Aug 12 01:22:02.800324 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Auth-Token: gAAAAABi9as6Wy-WpJ0ubjTQrA_VYV0bCDNVMnhy6zP9BvJ3WeXJHNGLQ61zHQy5bRnhrzl4DZsua97HcMuc-naPzdTXg7VJNbHTqr-O8u-cX7KYjMbtoqPom7dQafbgOb1yATLXJwYYrShx_B78LtfsZmKYx3TW_RURAWt05_xT9OSvk6BPM2M Aug 12 01:22:02.800324 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Domain-Id: None Aug 12 01:22:02.800324 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Domain-Name: None Aug 12 01:22:02.800324 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Identity-Status: Confirmed Aug 12 01:22:02.800324 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Is-Admin-Project: True Aug 12 01:22:02.800324 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Openstack-Nova-Api-Version: 2.90 Aug 12 01:22:02.800324 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Project-Domain-Id: default Aug 12 01:22:02.800324 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Project-Domain-Name: Default Aug 12 01:22:02.800324 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Project-Id: c77071b47cbd4a83bfd54874694bd940 Aug 12 01:22:02.800324 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Project-Name: admin Aug 12 01:22:02.800324 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Role: admin,member,reader Aug 12 01:22:02.800324 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Roles: admin,member,reader Aug 12 01:22:02.801819 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c77071b47cbd4a83bfd54874694bd940"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c77071b47cbd4a83bfd54874694bd940"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c77071b47cbd4a83bfd54874694bd940"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c77071b47cbd4a83bfd54874694bd940"}]}] Aug 12 01:22:02.801819 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Tenant: admin Aug 12 01:22:02.801819 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Tenant-Id: c77071b47cbd4a83bfd54874694bd940 Aug 12 01:22:02.801819 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-Tenant-Name: admin Aug 12 01:22:02.801819 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-User: admin Aug 12 01:22:02.801819 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-User-Domain-Id: default Aug 12 01:22:02.801819 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-User-Domain-Name: Default Aug 12 01:22:02.801819 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-User-Id: 1ece3467c3f542a1b55493e0e53752eb Aug 12 01:22:02.801819 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: X-User-Name: admin Aug 12 01:22:02.801819 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: method: > Aug 12 01:22:02.801819 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: exception: Flavor 451 could not be found. Aug 12 01:22:02.801819 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: action_args: {'id': '451'} Aug 12 01:22:02.801819 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:22:02.801819 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:22:02.802704 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 12 01:22:02.802704 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 12 01:22:02.802704 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 12 01:22:02.802704 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 12 01:22:02.802704 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 12 01:22:02.802704 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 12 01:22:02.802704 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 12 01:22:02.802704 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 12 01:22:02.802704 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 12 01:22:02.802704 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:22:02.802704 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 12 01:22:02.802704 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 12 01:22:02.802704 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 12 01:22:02.802704 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi Aug 12 01:22:02.802704 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:22:02.802704 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi Aug 12 01:22:02.802704 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:22:02.802704 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:22:02.802704 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:22:02.803793 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:22:02.803793 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:22:02.803793 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:22:02.803793 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:22:02.803793 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 12 01:22:02.803793 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:22:02.803793 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 12 01:22:02.803793 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi Aug 12 01:22:02.803793 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:22:02.803793 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi Aug 12 01:22:02.803793 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:22:02.803793 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:22:02.803793 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:22:02.803793 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:22:02.803793 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:22:02.803793 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 12 01:22:02.803793 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: ERROR nova.api.openstack.wsgi Aug 12 01:22:02.803793 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-f8567844-8ea1-40c6-a4cf-7dc996c213da admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:22:02.804854 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.requestlog [None req-f8567844-8ea1-40c6-a4cf-7dc996c213da admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011986 Aug 12 01:22:02.804854 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: [pid: 105519|app: 0|req: 27/52] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Aug 12 01:22:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 12 01:22:03.772375 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-4ef9c894-7075-4dfd-8954-95bcc6f2ebe0 admin admin] Calling method '>' {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:22:03.773613 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.requestlog [None req-4ef9c894-7075-4dfd-8954-95bcc6f2ebe0 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001713 Aug 12 01:22:03.774000 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: [pid: 105520|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Aug 12 01:22:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:22:04.338073 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-0596fc92-4a5b-4503-8d34-71a79a972db7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:22:04.359825 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.requestlog [None req-0596fc92-4a5b-4503-8d34-71a79a972db7 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.446609 Aug 12 01:22:04.360356 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: [pid: 105519|app: 0|req: 28/54] 10.222.0.20 () {64 vars in 1235 bytes} [Fri Aug 12 01:22:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 01:22:05.348820 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-4ef9c894-7075-4dfd-8954-95bcc6f2ebe0 admin admin] Calling method '>' {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:22:05.349850 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.requestlog [None req-4ef9c894-7075-4dfd-8954-95bcc6f2ebe0 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 12 01:22:05.350271 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: [pid: 105520|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Aug 12 01:22:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:22:05.924913 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-884ff905-1049-4bde-97b2-5cd2c1efbd02 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:22:05.951296 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.requestlog [None req-884ff905-1049-4bde-97b2-5cd2c1efbd02 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.465261 Aug 12 01:22:05.951892 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: [pid: 105519|app: 0|req: 29/56] 10.222.0.20 () {64 vars in 1235 bytes} [Fri Aug 12 01:22:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 01:22:06.941389 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-4ef9c894-7075-4dfd-8954-95bcc6f2ebe0 admin admin] Calling method '>' {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:22:06.942433 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.requestlog [None req-4ef9c894-7075-4dfd-8954-95bcc6f2ebe0 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 12 01:22:06.942828 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: [pid: 105520|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Aug 12 01:22:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:22:07.501265 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-d150a7ac-cff7-47d8-9889-96f254c54b65 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:22:07.522425 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.requestlog [None req-d150a7ac-cff7-47d8-9889-96f254c54b65 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.441712 Aug 12 01:22:07.522961 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: [pid: 105519|app: 0|req: 30/58] 10.222.0.20 () {64 vars in 1235 bytes} [Fri Aug 12 01:22:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 01:22:08.510710 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-4ef9c894-7075-4dfd-8954-95bcc6f2ebe0 admin admin] Calling method '>' {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:22:08.511754 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.requestlog [None req-4ef9c894-7075-4dfd-8954-95bcc6f2ebe0 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Aug 12 01:22:08.512143 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: [pid: 105520|app: 0|req: 29/59] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Aug 12 01:22:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:22:09.076623 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-982b99b4-1eee-4154-a35c-60d5ed68d05a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:22:09.101008 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.requestlog [None req-982b99b4-1eee-4154-a35c-60d5ed68d05a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.452186 Aug 12 01:22:09.101549 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: [pid: 105519|app: 0|req: 31/60] 10.222.0.20 () {64 vars in 1235 bytes} [Fri Aug 12 01:22:08 2022] POST /compute/v2.1/flavors => generated 409 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 12 01:22:10.080994 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-4ef9c894-7075-4dfd-8954-95bcc6f2ebe0 admin admin] Calling method '>' {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:22:10.082313 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.requestlog [None req-4ef9c894-7075-4dfd-8954-95bcc6f2ebe0 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001937 Aug 12 01:22:10.082783 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: [pid: 105520|app: 0|req: 30/61] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Aug 12 01:22:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:22:10.634496 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-15d71cd3-ad43-4a9a-8f7f-69939b3e3353 admin admin] Calling method '>' {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:22:10.654689 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.requestlog [None req-15d71cd3-ad43-4a9a-8f7f-69939b3e3353 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.435665 Aug 12 01:22:10.655222 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: [pid: 105519|app: 0|req: 32/62] 10.222.0.20 () {60 vars in 1202 bytes} [Fri Aug 12 01:22:10 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:23:04.226097 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-4ef9c894-7075-4dfd-8954-95bcc6f2ebe0 admin admin] Calling method '>' {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:23:04.227114 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.requestlog [None req-4ef9c894-7075-4dfd-8954-95bcc6f2ebe0 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 12 01:23:04.227525 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: [pid: 105520|app: 0|req: 31/63] 10.222.0.20 () {54 vars in 931 bytes} [Fri Aug 12 01:23:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:23:04.238507 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG dbcounter [-] [105519] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:04.649490 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-1ab8f725-eaae-4859-af5f-c87deca6c8fe admin admin] Calling method '>' {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:23:04.672199 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.requestlog [None req-1ab8f725-eaae-4859-af5f-c87deca6c8fe admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.438204 Aug 12 01:23:04.672752 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: [pid: 105519|app: 0|req: 33/64] 10.222.0.20 () {60 vars in 1292 bytes} [Fri Aug 12 01:23:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:23:04.698805 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG dbcounter [-] [105520] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=105520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:04.703191 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-747a7bcd-3217-4d0e-a6a6-e7e8e3a740f5 admin admin] Calling method '>' {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:23:04.711307 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.requestlog [None req-747a7bcd-3217-4d0e-a6a6-e7e8e3a740f5 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013939 Aug 12 01:23:04.711867 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: [pid: 105520|app: 0|req: 32/65] 10.222.0.20 () {60 vars in 1283 bytes} [Fri Aug 12 01:23:04 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:23:04.731450 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-3f84a8f4-46bf-4b1d-b3d5-fd5014d0c300 admin admin] Calling method '>' {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:23:04.740460 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.requestlog [None req-3f84a8f4-46bf-4b1d-b3d5-fd5014d0c300 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015315 Aug 12 01:23:04.740971 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: [pid: 105519|app: 0|req: 34/66] 10.222.0.20 () {60 vars in 1286 bytes} [Fri Aug 12 01:23:04 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:23:04.752922 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-6dd4da98-ef9b-495b-8692-0cf933f90ddc admin admin] Calling method '>' {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:23:04.761512 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.requestlog [None req-6dd4da98-ef9b-495b-8692-0cf933f90ddc admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012341 Aug 12 01:23:04.762035 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: [pid: 105520|app: 0|req: 33/67] 10.222.0.20 () {60 vars in 1286 bytes} [Fri Aug 12 01:23:04 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:23:04.773836 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-e5d9b52f-f804-4efc-b40f-755654852f2f admin admin] Calling method '>' {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:23:04.781632 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.requestlog [None req-e5d9b52f-f804-4efc-b40f-755654852f2f admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011349 Aug 12 01:23:04.782140 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: [pid: 105519|app: 0|req: 35/68] 10.222.0.20 () {60 vars in 1283 bytes} [Fri Aug 12 01:23:04 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:26:03.205287 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-6dd4da98-ef9b-495b-8692-0cf933f90ddc admin admin] Calling method '>' {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:26:03.206289 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.requestlog [None req-6dd4da98-ef9b-495b-8692-0cf933f90ddc admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Aug 12 01:26:03.206643 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: [pid: 105520|app: 0|req: 34/69] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Aug 12 01:26:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:26:03.348334 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG dbcounter [-] [105519] Writing DB stats nova_api:SELECT=6 {{(pid=105519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:26:03.536316 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-cb70dde9-c671-4c1d-baa1-f5e7b027937f admin admin] Calling method '>' {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:26:03.538628 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 01:26:03.538628 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: warnings.warn(msg) Aug 12 01:26:03.539767 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG oslo_concurrency.lockutils [None req-cb70dde9-c671-4c1d-baa1-f5e7b027937f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:26:03.540231 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG oslo_concurrency.lockutils [None req-cb70dde9-c671-4c1d-baa1-f5e7b027937f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:26:03.540648 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG oslo_concurrency.lockutils [None req-cb70dde9-c671-4c1d-baa1-f5e7b027937f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:26:03.541345 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG oslo_concurrency.lockutils [None req-cb70dde9-c671-4c1d-baa1-f5e7b027937f admin admin] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:26:03.541779 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG oslo_concurrency.lockutils [None req-cb70dde9-c671-4c1d-baa1-f5e7b027937f admin admin] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:26:03.542184 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG oslo_concurrency.lockutils [None req-cb70dde9-c671-4c1d-baa1-f5e7b027937f admin admin] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:26:03.576190 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.requestlog [None req-cb70dde9-c671-4c1d-baa1-f5e7b027937f admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.230516 Aug 12 01:26:03.576730 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: [pid: 105519|app: 0|req: 36/70] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Aug 12 01:26:03 2022] GET /compute/v2.1/os-services => generated 794 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 01:26:04.444356 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-6dd4da98-ef9b-495b-8692-0cf933f90ddc admin admin] Calling method '>' {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:26:04.445354 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.requestlog [None req-6dd4da98-ef9b-495b-8692-0cf933f90ddc admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 12 01:26:04.445738 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: [pid: 105520|app: 0|req: 35/71] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Aug 12 01:26:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:26:04.651314 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-4191ea97-3938-4078-98ae-8dd95294216f admin admin] Calling method '>' {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:26:04.653798 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 01:26:04.653798 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: warnings.warn(msg) Aug 12 01:26:04.654911 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG oslo_concurrency.lockutils [None req-4191ea97-3938-4078-98ae-8dd95294216f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:26:04.655412 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG oslo_concurrency.lockutils [None req-4191ea97-3938-4078-98ae-8dd95294216f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:26:04.655961 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG oslo_concurrency.lockutils [None req-4191ea97-3938-4078-98ae-8dd95294216f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:26:04.656681 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG oslo_concurrency.lockutils [None req-4191ea97-3938-4078-98ae-8dd95294216f admin admin] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:26:04.657110 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG oslo_concurrency.lockutils [None req-4191ea97-3938-4078-98ae-8dd95294216f admin admin] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:26:04.657514 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG oslo_concurrency.lockutils [None req-4191ea97-3938-4078-98ae-8dd95294216f admin admin] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:26:04.676354 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.requestlog [None req-4191ea97-3938-4078-98ae-8dd95294216f admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.092818 Aug 12 01:26:04.676890 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: [pid: 105519|app: 0|req: 37/72] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Aug 12 01:26:04 2022] GET /compute/v2.1/os-services => generated 794 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 01:26:15.925911 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-6dd4da98-ef9b-495b-8692-0cf933f90ddc admin admin] Calling method '>' {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:26:15.927277 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.requestlog [None req-6dd4da98-ef9b-495b-8692-0cf933f90ddc admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002018 Aug 12 01:26:15.927817 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: [pid: 105520|app: 0|req: 36/73] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Aug 12 01:26:15 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:26:16.074134 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG dbcounter [-] [105519] Writing DB stats nova_cell0:SELECT=4 {{(pid=105519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:26:16.074932 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG dbcounter [-] [105519] Writing DB stats nova_cell1:SELECT=4 {{(pid=105519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:26:16.075705 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG dbcounter [-] [105519] Writing DB stats nova_api:SELECT=8 {{(pid=105519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:26:16.129604 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-5d1f2cea-5d18-45c0-ab5e-fb8808dd04e0 admin admin] Calling method '>' {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:26:16.132023 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 01:26:16.132023 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: warnings.warn(msg) Aug 12 01:26:16.133121 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG oslo_concurrency.lockutils [None req-5d1f2cea-5d18-45c0-ab5e-fb8808dd04e0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:26:16.133591 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG oslo_concurrency.lockutils [None req-5d1f2cea-5d18-45c0-ab5e-fb8808dd04e0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:26:16.133994 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG oslo_concurrency.lockutils [None req-5d1f2cea-5d18-45c0-ab5e-fb8808dd04e0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:26:16.134699 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG oslo_concurrency.lockutils [None req-5d1f2cea-5d18-45c0-ab5e-fb8808dd04e0 admin admin] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:26:16.135151 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG oslo_concurrency.lockutils [None req-5d1f2cea-5d18-45c0-ab5e-fb8808dd04e0 admin admin] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:26:16.135579 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG oslo_concurrency.lockutils [None req-5d1f2cea-5d18-45c0-ab5e-fb8808dd04e0 admin admin] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:26:16.160027 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.requestlog [None req-5d1f2cea-5d18-45c0-ab5e-fb8808dd04e0 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.093330 Aug 12 01:26:16.160564 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: [pid: 105519|app: 0|req: 38/74] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Aug 12 01:26:16 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:26:16.999932 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: DEBUG nova.api.openstack.wsgi [None req-6dd4da98-ef9b-495b-8692-0cf933f90ddc admin admin] Calling method '>' {{(pid=105520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:26:17.000996 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: INFO nova.api.openstack.requestlog [None req-6dd4da98-ef9b-495b-8692-0cf933f90ddc admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Aug 12 01:26:17.001387 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: [pid: 105520|app: 0|req: 37/75] 10.222.0.20 () {56 vars in 1074 bytes} [Fri Aug 12 01:26:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:26:17.202581 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG nova.api.openstack.wsgi [None req-55781db7-c24b-42f6-96ba-8dbd35056e90 admin admin] Calling method '>' {{(pid=105519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:26:17.204912 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 01:26:17.204912 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: warnings.warn(msg) Aug 12 01:26:17.206014 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG oslo_concurrency.lockutils [None req-55781db7-c24b-42f6-96ba-8dbd35056e90 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:26:17.206502 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG oslo_concurrency.lockutils [None req-55781db7-c24b-42f6-96ba-8dbd35056e90 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:26:17.206948 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG oslo_concurrency.lockutils [None req-55781db7-c24b-42f6-96ba-8dbd35056e90 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:26:17.207678 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG oslo_concurrency.lockutils [None req-55781db7-c24b-42f6-96ba-8dbd35056e90 admin admin] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:26:17.208119 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG oslo_concurrency.lockutils [None req-55781db7-c24b-42f6-96ba-8dbd35056e90 admin admin] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:26:17.208527 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: DEBUG oslo_concurrency.lockutils [None req-55781db7-c24b-42f6-96ba-8dbd35056e90 admin admin] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:26:17.230217 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: INFO nova.api.openstack.requestlog [None req-55781db7-c24b-42f6-96ba-8dbd35056e90 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.091856 Aug 12 01:26:17.230738 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: [pid: 105519|app: 0|req: 39/76] 10.222.0.20 () {60 vars in 1193 bytes} [Fri Aug 12 01:26:17 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:27:11.879144 dv-cinder-784815-15-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 12 01:27:11.879963 dv-cinder-784815-15-iscsi devstack@n-api.service[105518]: Fri Aug 12 01:27:11 2022 - graceful shutdown triggered... Aug 12 01:27:11.880528 dv-cinder-784815-15-iscsi devstack@n-api.service[105520]: Gracefully killing worker 2 (pid: 105520)... Aug 12 01:27:11.880892 dv-cinder-784815-15-iscsi devstack@n-api.service[105519]: Gracefully killing worker 1 (pid: 105519)... Aug 12 01:27:12.881030 dv-cinder-784815-15-iscsi devstack@n-api.service[105518]: worker 1 buried after 1 seconds Aug 12 01:27:12.881030 dv-cinder-784815-15-iscsi devstack@n-api.service[105518]: worker 2 buried after 1 seconds Aug 12 01:27:12.881030 dv-cinder-784815-15-iscsi devstack@n-api.service[105518]: goodbye to uWSGI. Aug 12 01:27:12.883769 dv-cinder-784815-15-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 12 01:27:12.884637 dv-cinder-784815-15-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 12 01:27:12.889156 dv-cinder-784815-15-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 12 01:27:12.902651 dv-cinder-784815-15-iscsi devstack@n-api.service[120770]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 12 01:27:12.905291 dv-cinder-784815-15-iscsi devstack@n-api.service[120770]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 12 01:27:12 2022] *** Aug 12 01:27:12.905475 dv-cinder-784815-15-iscsi devstack@n-api.service[120770]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 12 01:27:12.905475 dv-cinder-784815-15-iscsi devstack@n-api.service[120770]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 12 01:27:12.905475 dv-cinder-784815-15-iscsi devstack@n-api.service[120770]: nodename: dv-cinder-784815-15-iscsi Aug 12 01:27:12.905475 dv-cinder-784815-15-iscsi devstack@n-api.service[120770]: machine: x86_64 Aug 12 01:27:12.905475 dv-cinder-784815-15-iscsi devstack@n-api.service[120770]: clock source: unix Aug 12 01:27:12.905475 dv-cinder-784815-15-iscsi devstack@n-api.service[120770]: pcre jit disabled Aug 12 01:27:12.905475 dv-cinder-784815-15-iscsi devstack@n-api.service[120770]: detected number of CPU cores: 4 Aug 12 01:27:12.905475 dv-cinder-784815-15-iscsi devstack@n-api.service[120770]: current working directory: / Aug 12 01:27:12.905475 dv-cinder-784815-15-iscsi devstack@n-api.service[120770]: detected binary path: /usr/bin/uwsgi-core Aug 12 01:27:12.905475 dv-cinder-784815-15-iscsi devstack@n-api.service[120770]: your processes number limit is 47680 Aug 12 01:27:12.905475 dv-cinder-784815-15-iscsi devstack@n-api.service[120770]: your memory page size is 4096 bytes Aug 12 01:27:12.905475 dv-cinder-784815-15-iscsi devstack@n-api.service[120770]: detected max file descriptor number: 2048 Aug 12 01:27:12.905475 dv-cinder-784815-15-iscsi devstack@n-api.service[120770]: lock engine: pthread robust mutexes Aug 12 01:27:12.906337 dv-cinder-784815-15-iscsi devstack@n-api.service[120770]: thunder lock: enabled Aug 12 01:27:12.906337 dv-cinder-784815-15-iscsi devstack@n-api.service[120770]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 12 01:27:12.906337 dv-cinder-784815-15-iscsi devstack@n-api.service[120770]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 12 01:27:12.945109 dv-cinder-784815-15-iscsi devstack@n-api.service[120770]: Python main interpreter initialized at 0x55b58bd339c0 Aug 12 01:27:12.945109 dv-cinder-784815-15-iscsi devstack@n-api.service[120770]: python threads support enabled Aug 12 01:27:12.945109 dv-cinder-784815-15-iscsi devstack@n-api.service[120770]: your server socket listen backlog is limited to 100 connections Aug 12 01:27:12.945109 dv-cinder-784815-15-iscsi devstack@n-api.service[120770]: your mercy for graceful operations on workers is 90 seconds Aug 12 01:27:12.945579 dv-cinder-784815-15-iscsi devstack@n-api.service[120770]: mapped 403077 bytes (393 KB) for 2 cores Aug 12 01:27:12.945579 dv-cinder-784815-15-iscsi devstack@n-api.service[120770]: *** Operational MODE: preforking *** Aug 12 01:27:12.945831 dv-cinder-784815-15-iscsi devstack@n-api.service[120770]: *** uWSGI is running in multiple interpreter mode *** Aug 12 01:27:12.945831 dv-cinder-784815-15-iscsi devstack@n-api.service[120770]: spawned uWSGI master process (pid: 120770) Aug 12 01:27:12.946019 dv-cinder-784815-15-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 12 01:27:12.946993 dv-cinder-784815-15-iscsi devstack@n-api.service[120770]: spawned uWSGI worker 1 (pid: 120785, cores: 1) Aug 12 01:27:12.946993 dv-cinder-784815-15-iscsi devstack@n-api.service[120770]: spawned uWSGI worker 2 (pid: 120786, cores: 1) Aug 12 01:27:12.947175 dv-cinder-784815-15-iscsi devstack@n-api.service[120770]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 12 01:27:13.605183 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 12 01:27:13.605866 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 12 01:27:14.749113 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 01:27:14.749113 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: from cryptography.utils import int_from_bytes Aug 12 01:27:14.749806 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 01:27:14.749806 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: from cryptography.utils import int_from_bytes Aug 12 01:27:14.761832 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 01:27:14.761832 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: from cryptography.utils import int_from_bytes Aug 12 01:27:14.762437 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 01:27:14.762437 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: from cryptography.utils import int_from_bytes Aug 12 01:27:17.139260 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 12 01:27:17.140235 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 12 01:27:17.140919 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 12 01:27:17.141439 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 12 01:27:17.141847 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 12 01:27:17.142395 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.142870 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.143345 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.143842 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.144313 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.144785 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.145251 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.145759 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.146241 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.146640 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.147112 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.147621 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784815-15-iscsi {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.148101 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.148561 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.149012 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.149474 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.149934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.150417 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.150873 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.151572 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.153098 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.153098 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.153098 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.153098 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.153440 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.153514 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.153816 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.154144 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.154470 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.154785 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.155182 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784815-15-iscsi {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.155498 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.155834 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.156148 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.156555 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.156869 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.157188 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.157495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.157824 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.158134 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.158454 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.158745 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.159085 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.159388 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.159708 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.160006 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.160307 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.160618 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.160927 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.161301 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.161540 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.161847 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.162161 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.162478 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.162795 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.163039 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.163271 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.163605 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.163920 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.164227 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.164530 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.164830 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.165135 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.165436 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.165754 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.166080 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.166392 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.166704 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.167013 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.167330 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.167666 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.167980 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.168470 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.168723 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.169029 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.169371 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.169905 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.170461 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.171024 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.171454 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.171816 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.172130 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.172447 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.172777 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.173122 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.173431 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.173682 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.173984 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.174292 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.174606 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.174912 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.175218 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.175546 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.175847 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.176154 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.176463 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.176933 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.177416 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.177888 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.178429 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.178975 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.179391 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.179788 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.180128 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.180463 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.180782 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.181092 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.181401 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.181707 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.182401 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.182964 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.183585 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.184175 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.184748 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.186543 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.186543 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.186543 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.186543 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.186543 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.187436 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.187436 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.187436 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.187994 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.187994 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.189192 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.189192 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.189192 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.189628 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.190095 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.190564 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.191096 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.191730 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.192302 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.194799 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.194799 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.194799 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.194799 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.195394 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.195394 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.195726 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.196281 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.196884 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.197500 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.198118 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.198664 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.201635 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.201635 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.201635 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.201635 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.201635 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.201635 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.203389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.203389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.203389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.203389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.203389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.204122 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.204122 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.204407 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.204553 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.204835 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.205182 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.205532 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.205973 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.206232 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.206531 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.206985 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.207297 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.207605 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.207957 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.208313 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.208626 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.209032 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.209324 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.209662 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.210123 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.210686 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.211245 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.211746 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.212094 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.212441 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.213417 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.213417 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.213417 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.213869 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.214021 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.214256 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.214566 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.214874 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.215190 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.215492 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.215838 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.216285 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.216578 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.216896 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.217439 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.217993 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.218552 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.219517 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.219517 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.219517 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.220028 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.220178 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.220473 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.220774 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.221083 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.221413 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.221717 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.222025 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.222343 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.222651 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.223703 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.223703 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.224031 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.224181 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.224529 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.225065 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.225658 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.226217 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.226627 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.226970 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.227307 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.227659 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.227956 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.228273 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.228583 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.228912 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.229251 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.229663 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.230085 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.230505 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.230920 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.231356 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.231823 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.232287 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.232741 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.233519 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.233965 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.234124 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.234471 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.234922 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.235438 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.236004 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.236339 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.236667 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.236981 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.237296 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.237607 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.238003 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.238320 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.238636 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.239214 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.239806 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.240385 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.240719 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.241060 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.241387 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.241717 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.242029 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.242357 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.246435 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.246435 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.246435 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.246435 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.246435 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.246435 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.246435 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.246435 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.247893 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.247893 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.247893 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.247893 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.248416 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.248565 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.248854 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.249175 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.249505 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.249914 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.250351 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.250812 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.251303 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.251794 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.252262 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.252789 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.253176 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.254115 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.254115 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.254480 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.255662 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.255662 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.256021 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.256258 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.256677 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.256883 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.257190 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.257496 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.257799 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.258101 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.258420 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.258745 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.259058 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.259379 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.259722 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.260065 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.260483 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.260925 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.261359 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.261825 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.262272 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.262733 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.263238 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.263722 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.264367 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.264556 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.265034 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.265498 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.265929 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.266249 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.266560 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.266938 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.267267 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.267489 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.267911 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.268224 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.269565 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.269565 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.269565 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.270125 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.272573 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.272573 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.272573 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.272573 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.272573 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.272573 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.275924 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.275924 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.275924 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.275924 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.275924 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.275924 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.275924 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.275924 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.277273 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.277273 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.277273 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.277273 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.277273 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.278080 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.278080 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.278921 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.278921 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.279236 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.279569 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.279897 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.280209 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.280539 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.280847 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.281163 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.281468 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.281797 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.282105 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.282411 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.282712 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.283059 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.283443 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.283804 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.284248 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.284922 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.285435 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.285897 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.286260 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.286597 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.286912 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.287332 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.287519 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.287853 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.288166 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.288472 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.288785 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.289096 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.289413 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.289726 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.290034 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.290342 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.290731 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.291050 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.291358 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.291916 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.292469 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.293024 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.293406 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.293725 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.294046 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.294357 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.294679 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.295032 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.295298 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.295646 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.296039 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.296264 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.296568 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.296892 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.297205 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.297575 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.297838 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.298196 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.298496 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.298865 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.299410 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.300012 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.300524 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.300842 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.301167 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.301480 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.301933 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.302248 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.302564 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.302871 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.303181 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.303494 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.303824 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.304135 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.304457 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.304768 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.305147 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.305464 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.305770 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.306277 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.307191 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.307999 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.308399 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.308800 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.309200 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.309594 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.309986 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.310374 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.310752 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.311143 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.311574 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.311945 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.312317 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.312693 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.313161 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.313545 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.314036 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.314695 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.315350 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.315840 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.316252 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.316605 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.316997 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.317410 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.318063 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.318429 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.318814 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.319202 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.319605 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.319992 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.320376 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.320757 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.321216 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.321602 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.322017 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.322678 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.323310 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.323851 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.324244 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.324635 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.325020 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.325404 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.325952 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.326384 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.326688 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.327063 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.327445 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.328022 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.328253 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.328670 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.329045 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.329744 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.330384 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.331005 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.331405 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.331810 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.332199 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.332588 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.333094 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.333497 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.333866 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.334243 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.334636 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.335011 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.336071 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.336071 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.336660 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.337011 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.337846 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.338397 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.338734 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.339145 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.345956 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.345956 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.345956 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.345956 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.345956 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.345956 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.345956 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.345956 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.347724 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.347724 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.347724 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.347724 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.347724 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.347724 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.347724 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.347724 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.350666 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.350666 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.350666 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.350666 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.350666 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.350666 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.350666 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.350666 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.351333 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.351333 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.351333 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.351333 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.351333 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.351333 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.351333 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.351965 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.352354 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.353153 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.354150 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.354266 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.354555 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.354873 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.355207 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.355564 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.355878 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.356188 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.356503 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.356854 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.357163 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.357486 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.357823 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.358207 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.358524 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.358861 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.359190 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.359936 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.359936 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.360251 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.360612 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.361153 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.361700 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.362251 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.362592 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.362909 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.363230 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.363560 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.363927 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.364340 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.364672 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.364981 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.365306 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.365617 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.365923 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.366229 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.366538 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.366881 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.367185 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.367622 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.367937 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.368264 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.368582 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.368896 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.369211 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.369612 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.369934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.370253 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.370778 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.371328 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.371948 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.372316 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.372657 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.373228 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.373575 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.373895 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.374214 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.374532 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.374855 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.375171 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.375490 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.375837 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.376155 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.376472 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.376801 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.377133 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.377548 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.377888 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.378281 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.378833 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.379395 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.379988 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.380364 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.380689 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.381004 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.381324 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.381645 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.381965 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.382281 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.382594 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.382909 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.383220 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.383549 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.383873 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.384171 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.384481 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.384806 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.385136 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.385455 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.385765 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.386076 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.386396 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.387010 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.387328 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.387693 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.388261 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.388832 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.389401 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.389748 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.390087 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.390403 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.390717 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.391035 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.391350 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.391683 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.392007 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.392321 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.392629 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.392947 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.393256 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.393806 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.394153 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.394549 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.394885 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.395209 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.395946 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.396506 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.397063 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.397389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.397708 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.398032 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.398350 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.398660 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.398971 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.399284 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.399630 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.399926 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.400235 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.400540 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.400871 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.401179 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.401484 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.401790 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.402104 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.402410 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.402737 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.403098 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.403406 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.403786 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.404327 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.404872 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.405418 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.405752 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.406072 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.406398 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.406720 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.407053 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.407364 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.407750 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.408079 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.408393 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.408719 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.409034 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.409351 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.409700 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.410016 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.410572 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.410905 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.411256 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.411619 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.412014 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.412325 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.412633 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.412946 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.413280 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.413575 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.413885 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.414199 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.414508 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.414815 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.415122 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.415432 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.415763 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.416072 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.416386 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.416693 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.417006 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.417313 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.417619 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.417986 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.418327 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.418648 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.418965 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.419278 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.419614 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.419971 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.420282 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.420591 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.420909 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.421212 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.421541 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.421852 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.422153 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.422698 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.423015 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.423330 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.423687 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.423996 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.424320 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.424639 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.424951 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.425266 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.425572 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.425898 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.426233 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.426561 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.426965 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.427285 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.427611 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.427942 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.428232 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.428551 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.428854 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.429159 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.429461 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.429768 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.430070 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.430373 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.430675 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.431562 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.431562 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.431562 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.432233 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.432535 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.432834 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.433136 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.433433 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.433739 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.434039 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.434339 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.434639 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.434941 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.435240 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.435595 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.435930 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.436242 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.436567 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.436878 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.437196 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.437502 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.437819 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.438138 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.438454 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.438766 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.439095 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.439403 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.439735 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.440044 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.440353 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.440658 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.440965 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.441317 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.441622 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.441923 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.442246 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.442598 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.442921 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.443233 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.443562 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.443886 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.444195 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.444505 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.444812 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.445121 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.445435 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.445740 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.447622 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.447955 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.448275 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.448591 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.448917 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.449240 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.449549 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.449873 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.450195 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.450541 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.450905 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.451247 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.451597 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.451969 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.452231 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.452579 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.452856 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 12 01:27:17.493604 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 12 01:27:17.494218 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 12 01:27:17.494411 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 12 01:27:17.494779 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 12 01:27:17.495040 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 12 01:27:17.495565 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.496045 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.496502 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.496832 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.497170 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.497524 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.497810 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.498155 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.498479 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.498689 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.499033 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.499344 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784815-15-iscsi {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.499695 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.500190 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.500754 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.501312 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.501851 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.502424 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.502894 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.503774 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.504110 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.504433 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.504739 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.505189 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.505515 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.505833 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.506158 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.506472 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.506808 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.507123 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.507567 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784815-15-iscsi {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.508050 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.508375 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.508694 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.509122 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.509438 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.509753 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.510075 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.510418 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.510737 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.511077 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.511651 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.512210 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.512780 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.513327 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.513801 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.514374 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.514848 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.515171 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.515489 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.515778 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.516098 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.516627 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.517196 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.517774 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.518142 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.518406 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.518751 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.519066 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.519380 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.519724 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.520040 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.520352 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.520846 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.521374 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.521937 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.522482 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.523067 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.523694 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.524260 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.524796 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.525361 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.525934 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.526194 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.526520 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.526878 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.527210 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.527559 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.527880 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.528209 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.528525 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.528842 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.529164 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.529489 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.529839 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.530148 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.530402 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.530705 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.531021 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.531339 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.531669 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.531988 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.532296 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.532596 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.532905 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.533217 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.533523 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.533831 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.534143 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.534448 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.534755 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.535092 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.535364 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.535713 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.536037 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.536391 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.536700 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.537005 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.537311 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.537631 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.537940 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.538246 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.538568 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.538873 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.539182 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.539503 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.539844 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.540152 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.540469 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.540768 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.541075 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.541392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.541695 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.542202 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.542738 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.543268 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.543855 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.544403 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.544891 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.545457 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.545804 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.546137 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.546477 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.546810 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.547302 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.547881 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.548835 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:27:17.548967 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.549265 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.549622 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.550213 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.550371 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.550609 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.550930 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.551248 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.551599 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.552019 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.552443 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.552643 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.552958 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.553398 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.553635 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.554118 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.554459 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.554780 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.555097 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.555450 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.555760 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.556094 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.556423 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.556740 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.557414 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.557764 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.558082 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.558411 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.558743 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.559056 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.559369 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.559707 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.560034 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.560371 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.560687 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.561009 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.561321 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.561637 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.561946 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.562261 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.562661 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.563260 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.563942 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.564433 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.568753 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.568753 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.568753 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.568753 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.568753 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.568753 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.568753 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.568753 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.570099 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.570099 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.570099 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.570099 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.570099 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.570734 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.570734 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.571134 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.571134 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.571593 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.571817 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.572047 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.572855 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.572855 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.573305 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.573305 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.573547 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.573908 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.574216 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.574526 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.574908 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.575405 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.576005 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.576564 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.577125 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.577741 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.578290 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.578815 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.579404 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.579869 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.580193 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.580506 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.580851 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.581178 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.581545 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.581935 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.587184 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.587184 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.587184 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.587184 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.587184 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.587184 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.588718 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.588833 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.589163 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.589672 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.590043 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.590497 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.590836 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.591361 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.591584 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.592039 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.592443 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.592798 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.593286 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.593880 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.594398 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.595044 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.595742 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.596522 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.597076 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.597617 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.598040 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.598375 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.598921 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.599369 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.599781 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.600170 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.600651 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.601110 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.601549 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.602002 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.602448 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.602852 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.603388 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.603809 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.604142 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.604465 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.604912 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.605479 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.606055 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.606643 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.607154 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.607789 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.608221 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.608564 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.608896 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.609233 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.609549 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.610101 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.610737 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.611207 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.611542 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.611883 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.612216 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.612537 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.612860 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.613182 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.613494 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.613806 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.614135 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.614518 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.614838 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.615278 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.615615 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.615940 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.616257 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.616566 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.616875 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.617194 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.617524 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.617850 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.618179 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.618509 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.618821 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.618925 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO dbcounter [None req-65792163-7d9d-4c1b-bc06-2a1196709324 None None] Registered counter for database nova_api Aug 12 01:27:17.620371 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.620371 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.620371 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.620371 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.620371 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.620731 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.621009 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.621326 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.621632 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.621954 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.622278 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.622591 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.623148 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.623265 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.623615 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.623867 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.624193 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.624516 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.624817 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.625273 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.625825 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.626392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.626901 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.627499 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.627990 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.628320 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.628641 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.628969 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.629298 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.630196 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.630541 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.630874 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.631200 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.631591 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.631951 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.632290 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.632751 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.633366 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.633917 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.634381 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.634709 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.635030 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.635353 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.635720 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.636043 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.637402 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.637402 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.637402 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.637402 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.637920 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.638031 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.638274 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.638594 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.638897 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.639205 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.639592 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.639894 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.640205 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.640521 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.640827 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.641174 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.641965 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.642118 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.642338 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.642685 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.642995 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.643304 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.643656 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.643938 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_db.sqlalchemy.engines [None req-65792163-7d9d-4c1b-bc06-2a1196709324 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120785) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 01:27:17.644042 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.644259 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.644567 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.644883 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.645193 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.645528 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.645874 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.646221 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.646540 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.646849 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.647171 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.647477 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.647849 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.648134 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.648434 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.648737 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.649074 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.649534 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.650071 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.650614 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.651170 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.651392 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writer thread running {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 01:27:17.651665 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.652280 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.652741 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.653033 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.653379 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.653685 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.653992 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.654354 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.654958 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.655555 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.656019 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.656334 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.656654 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.657057 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.657613 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.658159 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.658751 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.659324 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.659897 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.660391 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.660722 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.661046 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.661462 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.661806 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.662314 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.662636 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.663966 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.664312 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.666135 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.666505 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.666846 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.667180 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.667516 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.668938 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.669316 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.669639 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.670147 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.670544 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.671136 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.671772 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.672362 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.672885 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.673469 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.673825 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.674160 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.674494 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.674822 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.675211 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.675844 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.676407 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.676768 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.677103 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.677490 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.677897 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.678239 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.678556 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.678882 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.679194 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.679513 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.679855 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.680175 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.680500 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.680821 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.681130 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.681451 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.682165 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.682413 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.682728 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.683043 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.683433 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.683835 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.684108 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.684421 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.684736 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.685045 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.685362 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.685671 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.686115 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.686434 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.686751 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.687060 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.687377 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.687718 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.688040 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.688360 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.688670 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.689097 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.689414 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.689737 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.690050 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.690358 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.690668 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.690983 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.691314 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.691647 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.691957 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.692286 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.692890 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.693432 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.694017 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.694742 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.695294 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.695849 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.696288 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.696615 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.696937 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.697274 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.697920 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.698529 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.699041 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.699373 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.699840 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.700192 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.700528 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.700854 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.701183 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.701496 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.701826 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.702210 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.702486 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.702812 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.703234 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.703583 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.703903 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.704239 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.704569 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.704881 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.705186 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.705500 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.705824 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.706111 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.706564 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.706879 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.707197 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.707513 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.707850 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.708190 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.708504 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.708837 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.709145 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.709479 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.709784 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.710112 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.710435 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.710745 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.711622 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.711622 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.711905 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.712046 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.712292 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.712647 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.713093 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.713663 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.714303 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.714630 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.context [None req-65792163-7d9d-4c1b-bc06-2a1196709324 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),330ae0cc-8e41-4294-877c-2d5d49260da2(cell1) {{(pid=120785) load_cells /opt/stack/nova/nova/context.py:464}} Aug 12 01:27:17.714959 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.715346 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.715996 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.716354 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.716691 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.717022 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.717359 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.717709 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.718277 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.718877 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.719444 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.719751 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-65792163-7d9d-4c1b-bc06-2a1196709324 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:27:17.719889 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.720211 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.720349 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-65792163-7d9d-4c1b-bc06-2a1196709324 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:27:17.720533 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.720850 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.721168 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.721477 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.721807 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.721960 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-65792163-7d9d-4c1b-bc06-2a1196709324 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:27:17.722101 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.722432 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.722614 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-65792163-7d9d-4c1b-bc06-2a1196709324 None None] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:27:17.722828 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.722984 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-65792163-7d9d-4c1b-bc06-2a1196709324 None None] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:27:17.723132 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.723339 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.723807 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.724161 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.724473 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.724808 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.725066 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-65792163-7d9d-4c1b-bc06-2a1196709324 None None] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:27:17.725209 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.725440 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.725765 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.726088 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.726405 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.726726 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.727048 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO dbcounter [None req-65792163-7d9d-4c1b-bc06-2a1196709324 None None] Registered counter for database nova_cell0 Aug 12 01:27:17.727180 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.727488 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.727840 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.728156 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.728476 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.728796 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.729118 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.729772 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.730113 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.730434 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.730751 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.731075 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.731206 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO dbcounter [None req-65792163-7d9d-4c1b-bc06-2a1196709324 None None] Registered counter for database nova_cell1 Aug 12 01:27:17.731396 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.731742 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.732061 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.732376 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.732692 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.733079 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.733405 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.733736 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.734066 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.734578 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.734893 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.735220 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.735553 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.735891 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.736256 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.736576 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.736887 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.737205 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.737697 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.738178 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.738499 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.738602 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_db.sqlalchemy.engines [None req-65792163-7d9d-4c1b-bc06-2a1196709324 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120785) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 01:27:17.738897 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.739234 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.739489 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.739828 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.740301 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.740404 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_db.sqlalchemy.engines [None req-65792163-7d9d-4c1b-bc06-2a1196709324 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120785) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 01:27:17.740619 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.740942 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.741273 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.741612 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.741938 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.742253 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.742566 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.742887 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.743446 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.743786 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.744121 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.744483 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.744907 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.745230 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.745555 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.745868 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.746175 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.746483 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.746918 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.747565 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.747769 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writer thread running {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 01:27:17.748126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.749172 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.749353 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writer thread running {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 01:27:17.749499 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.749824 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.750262 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.750589 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.751155 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.751513 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.752096 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.752684 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.753249 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.753547 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.753893 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.754232 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.754578 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.754941 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.755339 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.755690 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.756004 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.756316 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.756634 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.756949 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.757257 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.757647 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.757959 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.758292 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.759224 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.759224 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.759224 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.759729 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.759888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.760125 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.760435 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.760745 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.761063 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.761373 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.761691 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.762006 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.762322 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.762622 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.762945 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.763256 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.763619 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.763919 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.764505 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.765079 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.765632 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.766229 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.766751 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.767332 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.767776 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.768106 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.768973 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.769592 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.770029 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.770382 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.770767 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.771091 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.771415 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.771767 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.772099 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.772415 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.772733 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.773053 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.773367 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.773787 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.774343 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.774909 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.775596 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.776503 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.776808 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.777335 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.777898 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.778273 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.778603 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.779102 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.779468 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.782329 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.782936 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.783321 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.784007 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.784512 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.784701 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.785041 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.785423 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.785760 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.786293 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.786637 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.786958 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.787408 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.787761 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.788091 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.788421 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.788744 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.789079 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.789407 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.789725 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.790049 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.790364 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.790732 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.791080 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.791411 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.791768 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.792165 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.792542 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.793083 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.793636 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.794180 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.794507 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.794824 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.795139 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.795456 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.795809 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.796126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.796436 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.796750 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.797065 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.797373 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.797680 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.797987 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.798466 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.798769 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.799057 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.799367 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.799699 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.800004 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.800394 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.800709 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.801206 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.801822 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.802421 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.802765 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.803103 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.803430 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.803790 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.804108 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.804438 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.804768 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.805090 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.805403 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.805741 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.806055 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.806369 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.806685 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.807312 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.807645 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.807959 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.808387 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.808671 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.808978 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.809313 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.809634 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.809955 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.810269 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.810583 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.811050 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.811267 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.811702 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.812719 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.812719 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.813237 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.813793 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.814168 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.814433 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.814764 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.815087 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.815423 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.815787 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.816165 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.820026 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.820026 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.820026 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.820026 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.820026 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.820026 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.820026 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.820026 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.820655 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:27:17.820655 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 12 01:27:17.909652 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO dbcounter [None req-65792163-7d9d-4c1b-bc06-2a1196709324 None None] Registered counter for database nova_cell0 Aug 12 01:27:17.917519 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_db.sqlalchemy.engines [None req-65792163-7d9d-4c1b-bc06-2a1196709324 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120785) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 01:27:17.923354 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writer thread running {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 01:27:17.984201 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO dbcounter [None req-eda743d7-00e6-4429-b590-85f6461e1a27 None None] Registered counter for database nova_api Aug 12 01:27:18.004792 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_db.sqlalchemy.engines [None req-eda743d7-00e6-4429-b590-85f6461e1a27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120786) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 01:27:18.012668 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writer thread running {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 01:27:18.070058 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.context [None req-eda743d7-00e6-4429-b590-85f6461e1a27 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),330ae0cc-8e41-4294-877c-2d5d49260da2(cell1) {{(pid=120786) load_cells /opt/stack/nova/nova/context.py:464}} Aug 12 01:27:18.074927 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-eda743d7-00e6-4429-b590-85f6461e1a27 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:27:18.075426 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-eda743d7-00e6-4429-b590-85f6461e1a27 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:27:18.077052 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-eda743d7-00e6-4429-b590-85f6461e1a27 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:27:18.077820 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-eda743d7-00e6-4429-b590-85f6461e1a27 None None] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:27:18.078268 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-eda743d7-00e6-4429-b590-85f6461e1a27 None None] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:27:18.080313 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-eda743d7-00e6-4429-b590-85f6461e1a27 None None] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:27:18.082324 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO dbcounter [None req-eda743d7-00e6-4429-b590-85f6461e1a27 None None] Registered counter for database nova_cell0 Aug 12 01:27:18.086818 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO dbcounter [None req-eda743d7-00e6-4429-b590-85f6461e1a27 None None] Registered counter for database nova_cell1 Aug 12 01:27:18.094398 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_db.sqlalchemy.engines [None req-eda743d7-00e6-4429-b590-85f6461e1a27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120786) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 01:27:18.096970 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_db.sqlalchemy.engines [None req-eda743d7-00e6-4429-b590-85f6461e1a27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120786) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 01:27:18.102795 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writer thread running {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 01:27:18.104126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writer thread running {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 01:27:18.242127 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: WARNING keystonemiddleware.auth_token [None req-65792163-7d9d-4c1b-bc06-2a1196709324 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 01:27:18.248737 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO dbcounter [None req-eda743d7-00e6-4429-b590-85f6461e1a27 None None] Registered counter for database nova_cell0 Aug 12 01:27:18.250088 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: WARNING keystonemiddleware.auth_token [None req-65792163-7d9d-4c1b-bc06-2a1196709324 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 01:27:18.257698 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_db.sqlalchemy.engines [None req-eda743d7-00e6-4429-b590-85f6461e1a27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120786) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 01:27:18.264535 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writer thread running {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 01:27:18.584680 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: WARNING keystonemiddleware.auth_token [None req-eda743d7-00e6-4429-b590-85f6461e1a27 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 01:27:18.592005 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: WARNING keystonemiddleware.auth_token [None req-eda743d7-00e6-4429-b590-85f6461e1a27 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 01:27:18.593487 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: WARNING keystonemiddleware.auth_token [None req-65792163-7d9d-4c1b-bc06-2a1196709324 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 01:27:18.599780 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: WARNING keystonemiddleware.auth_token [None req-65792163-7d9d-4c1b-bc06-2a1196709324 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 01:27:18.606131 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b58bd339c0 pid: 120785 (default app) Aug 12 01:27:18.937473 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: WARNING keystonemiddleware.auth_token [None req-eda743d7-00e6-4429-b590-85f6461e1a27 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 01:27:18.943609 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: WARNING keystonemiddleware.auth_token [None req-eda743d7-00e6-4429-b590-85f6461e1a27 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 01:27:18.949833 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b58bd339c0 pid: 120786 (default app) Aug 12 01:27:54.177397 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_api:SELECT=3 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:27:54.178368 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell0:SELECT=3 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:27:54.179291 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell1:SELECT=3 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:27:54.181397 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell0:SELECT=3 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:27:55.708459 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-39f84587-8144-4a58-a013-33d641a11359 tempest-VolumesNegativeTest-1424139784 tempest-VolumesNegativeTest-1424139784-project] Action: 'create', calling method: .version_select at 0x7f2deeecbd30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1518366111", "metadata": {"Type": "work"}}} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:27:55.725510 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-39f84587-8144-4a58-a013-33d641a11359 tempest-VolumesNegativeTest-1424139784 tempest-VolumesNegativeTest-1424139784-project] Request method failure captured: Aug 12 01:27:55.725510 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 12 01:27:55.725510 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept: application/json Aug 12 01:27:55.725510 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept-Encoding: identity Aug 12 01:27:55.725510 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Connection: close Aug 12 01:27:55.725510 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Length: 122 Aug 12 01:27:55.725510 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Type: application/json Aug 12 01:27:55.725510 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Host: 10.222.0.20 Aug 12 01:27:55.725510 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Openstack-System-Scope: None Aug 12 01:27:55.725510 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: User-Agent: python-urllib3/1.26.11 Aug 12 01:27:55.725510 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Auth-Token: gAAAAABi9ayaiY2Cr26nvm1YNJz968-BdMjTPR8k3wlg1OyQK_dWS2WpJeZ8e_gaTOEfX6kN3PeTSiDuM_D3_WTBozbi4KtVnydoMK2AVHkm7-3h0G8dxCSHEbIByTh1S_nczTv684IVJYJxTatFfn3KKVInm_HzThODd4Vz4vgA-ZXovV5QNLc Aug 12 01:27:55.725510 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Id: None Aug 12 01:27:55.725510 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Name: None Aug 12 01:27:55.725510 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Identity-Status: Confirmed Aug 12 01:27:55.725510 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Is-Admin-Project: True Aug 12 01:27:55.725510 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Id: default Aug 12 01:27:55.725510 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Name: Default Aug 12 01:27:55.725510 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Id: e4bb614118524fc587332cc57fe7c357 Aug 12 01:27:55.725510 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Name: tempest-VolumesNegativeTest-1424139784 Aug 12 01:27:55.725510 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Role: member,reader Aug 12 01:27:55.725510 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Roles: member,reader Aug 12 01:27:55.726988 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e4bb614118524fc587332cc57fe7c357"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e4bb614118524fc587332cc57fe7c357"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e4bb614118524fc587332cc57fe7c357"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e4bb614118524fc587332cc57fe7c357"}]}] Aug 12 01:27:55.726988 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant: tempest-VolumesNegativeTest-1424139784 Aug 12 01:27:55.726988 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Id: e4bb614118524fc587332cc57fe7c357 Aug 12 01:27:55.726988 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Name: tempest-VolumesNegativeTest-1424139784 Aug 12 01:27:55.726988 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User: tempest-VolumesNegativeTest-1424139784-project Aug 12 01:27:55.726988 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Id: default Aug 12 01:27:55.726988 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Name: Default Aug 12 01:27:55.726988 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Id: 6527b9fe4dca4826b17e12f83eb4a992 Aug 12 01:27:55.726988 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Name: tempest-VolumesNegativeTest-1424139784-project Aug 12 01:27:55.726988 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Aug 12 01:27:55.726988 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1518366111", "metadata": {"Type": "work"}}} Aug 12 01:27:55.726988 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: method: Aug 12 01:27:55.726988 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 12 01:27:55.728679 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1518366111', 'metadata': {'Type': 'work'}}}} Aug 12 01:27:55.728679 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:27:55.728679 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:27:55.728679 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 12 01:27:55.728679 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 12 01:27:55.728679 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 12 01:27:55.728679 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise error Aug 12 01:27:55.728679 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 12 01:27:55.728679 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:27:55.728679 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 12 01:27:55.728679 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 12 01:27:55.728679 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:27:55.728679 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 12 01:27:55.728679 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi '#$%' Aug 12 01:27:55.728679 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:27:55.728679 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:27:55.728679 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:27:55.728679 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:27:55.728679 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:27:55.728679 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:27:55.728679 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:27:55.728679 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:27:55.730880 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 01:27:55.730880 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 01:27:55.730880 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:27:55.730880 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:27:55.730880 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 12 01:27:55.730880 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 12 01:27:55.730880 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 12 01:27:55.730880 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 12 01:27:55.730880 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 12 01:27:55.730880 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 12 01:27:55.730880 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 12 01:27:55.730880 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:27:55.730880 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:27:55.730880 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:27:55.730880 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:27:55.730880 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:27:55.730880 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:27:55.730880 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 12 01:27:55.730880 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 12 01:27:55.733065 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 12 01:27:55.733065 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:27:55.733065 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-39f84587-8144-4a58-a013-33d641a11359 tempest-VolumesNegativeTest-1424139784 tempest-VolumesNegativeTest-1424139784-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:27:55.738595 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-39f84587-8144-4a58-a013-33d641a11359 tempest-VolumesNegativeTest-1424139784 tempest-VolumesNegativeTest-1424139784-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.581717 Aug 12 01:27:55.739788 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 1/1] 10.222.0.20 () {60 vars in 1156 bytes} [Fri Aug 12 01:27:54 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1584 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 12 01:27:55.752657 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_api:SELECT=3 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:27:55.753669 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell0:SELECT=3 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:27:55.754616 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell1:SELECT=3 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:27:55.757671 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell0:SELECT=3 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:27:56.101144 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-3549a371-4d58-4f80-9231-4ac4cfcd1dac tempest-VolumesNegativeTest-1424139784 tempest-VolumesNegativeTest-1424139784-project] Action: 'create', calling method: .version_select at 0x7f2deef2c8b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1756508112", "metadata": {"Type": "work"}}} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:27:56.107675 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-3549a371-4d58-4f80-9231-4ac4cfcd1dac tempest-VolumesNegativeTest-1424139784 tempest-VolumesNegativeTest-1424139784-project] Request method failure captured: Aug 12 01:27:56.107675 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 12 01:27:56.107675 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept: application/json Aug 12 01:27:56.107675 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept-Encoding: identity Aug 12 01:27:56.107675 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Connection: close Aug 12 01:27:56.107675 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Length: 120 Aug 12 01:27:56.107675 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Type: application/json Aug 12 01:27:56.107675 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Host: 10.222.0.20 Aug 12 01:27:56.107675 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Openstack-System-Scope: None Aug 12 01:27:56.107675 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: User-Agent: python-urllib3/1.26.11 Aug 12 01:27:56.107675 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Auth-Token: gAAAAABi9ayaiY2Cr26nvm1YNJz968-BdMjTPR8k3wlg1OyQK_dWS2WpJeZ8e_gaTOEfX6kN3PeTSiDuM_D3_WTBozbi4KtVnydoMK2AVHkm7-3h0G8dxCSHEbIByTh1S_nczTv684IVJYJxTatFfn3KKVInm_HzThODd4Vz4vgA-ZXovV5QNLc Aug 12 01:27:56.107675 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Id: None Aug 12 01:27:56.107675 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Name: None Aug 12 01:27:56.107675 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Identity-Status: Confirmed Aug 12 01:27:56.107675 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Is-Admin-Project: True Aug 12 01:27:56.107675 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Id: default Aug 12 01:27:56.107675 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Name: Default Aug 12 01:27:56.107675 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Id: e4bb614118524fc587332cc57fe7c357 Aug 12 01:27:56.107675 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Name: tempest-VolumesNegativeTest-1424139784 Aug 12 01:27:56.107675 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Role: member,reader Aug 12 01:27:56.107675 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Roles: member,reader Aug 12 01:27:56.108983 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e4bb614118524fc587332cc57fe7c357"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e4bb614118524fc587332cc57fe7c357"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e4bb614118524fc587332cc57fe7c357"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e4bb614118524fc587332cc57fe7c357"}]}] Aug 12 01:27:56.108983 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant: tempest-VolumesNegativeTest-1424139784 Aug 12 01:27:56.108983 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Id: e4bb614118524fc587332cc57fe7c357 Aug 12 01:27:56.108983 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Name: tempest-VolumesNegativeTest-1424139784 Aug 12 01:27:56.108983 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User: tempest-VolumesNegativeTest-1424139784-project Aug 12 01:27:56.108983 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Id: default Aug 12 01:27:56.108983 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Name: Default Aug 12 01:27:56.108983 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Id: 6527b9fe4dca4826b17e12f83eb4a992 Aug 12 01:27:56.108983 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Name: tempest-VolumesNegativeTest-1424139784-project Aug 12 01:27:56.108983 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Aug 12 01:27:56.108983 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1756508112", "metadata": {"Type": "work"}}} Aug 12 01:27:56.108983 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: method: Aug 12 01:27:56.108983 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 12 01:27:56.110090 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1756508112', 'metadata': {'Type': 'work'}}}} Aug 12 01:27:56.110090 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:27:56.110090 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:27:56.110090 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 12 01:27:56.110090 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 12 01:27:56.110090 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 12 01:27:56.110090 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise error Aug 12 01:27:56.110090 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 12 01:27:56.110090 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:27:56.110090 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 12 01:27:56.110090 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 12 01:27:56.110090 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:27:56.110090 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 12 01:27:56.110090 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi '0' Aug 12 01:27:56.110090 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:27:56.110090 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:27:56.110090 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:27:56.110090 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:27:56.110090 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:27:56.110090 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:27:56.110090 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:27:56.110090 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:27:56.112888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 01:27:56.112888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 01:27:56.112888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:27:56.112888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:27:56.112888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 12 01:27:56.112888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 12 01:27:56.112888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 12 01:27:56.112888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 12 01:27:56.112888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 12 01:27:56.112888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 12 01:27:56.112888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 12 01:27:56.112888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:27:56.112888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:27:56.112888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:27:56.112888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:27:56.112888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:27:56.112888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:27:56.112888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 12 01:27:56.112888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 12 01:27:56.116240 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 12 01:27:56.116240 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:27:56.116240 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-3549a371-4d58-4f80-9231-4ac4cfcd1dac tempest-VolumesNegativeTest-1424139784 tempest-VolumesNegativeTest-1424139784-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:27:56.116240 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-3549a371-4d58-4f80-9231-4ac4cfcd1dac tempest-VolumesNegativeTest-1424139784 tempest-VolumesNegativeTest-1424139784-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.362442 Aug 12 01:27:56.116240 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 1/2] 10.222.0.20 () {60 vars in 1156 bytes} [Fri Aug 12 01:27:55 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 365 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 12 01:27:56.120213 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-0027b58a-9390-4124-8283-10b351c7217c tempest-VolumesNegativeTest-1424139784 tempest-VolumesNegativeTest-1424139784-project] Action: 'create', calling method: .version_select at 0x7f2deeddc820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-844963069", "metadata": {"Type": "work"}}} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:27:56.124110 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-0027b58a-9390-4124-8283-10b351c7217c tempest-VolumesNegativeTest-1424139784 tempest-VolumesNegativeTest-1424139784-project] Request method failure captured: Aug 12 01:27:56.124110 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 12 01:27:56.124110 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept: application/json Aug 12 01:27:56.124110 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept-Encoding: identity Aug 12 01:27:56.124110 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Connection: close Aug 12 01:27:56.124110 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Length: 118 Aug 12 01:27:56.124110 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Type: application/json Aug 12 01:27:56.124110 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Host: 10.222.0.20 Aug 12 01:27:56.124110 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Openstack-System-Scope: None Aug 12 01:27:56.124110 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: User-Agent: python-urllib3/1.26.11 Aug 12 01:27:56.124110 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Auth-Token: gAAAAABi9ayaiY2Cr26nvm1YNJz968-BdMjTPR8k3wlg1OyQK_dWS2WpJeZ8e_gaTOEfX6kN3PeTSiDuM_D3_WTBozbi4KtVnydoMK2AVHkm7-3h0G8dxCSHEbIByTh1S_nczTv684IVJYJxTatFfn3KKVInm_HzThODd4Vz4vgA-ZXovV5QNLc Aug 12 01:27:56.124110 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Id: None Aug 12 01:27:56.124110 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Name: None Aug 12 01:27:56.124110 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Identity-Status: Confirmed Aug 12 01:27:56.124110 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Is-Admin-Project: True Aug 12 01:27:56.124110 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Id: default Aug 12 01:27:56.124110 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Name: Default Aug 12 01:27:56.124110 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Id: e4bb614118524fc587332cc57fe7c357 Aug 12 01:27:56.124110 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Name: tempest-VolumesNegativeTest-1424139784 Aug 12 01:27:56.124110 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Role: member,reader Aug 12 01:27:56.124110 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Roles: member,reader Aug 12 01:27:56.126118 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e4bb614118524fc587332cc57fe7c357"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e4bb614118524fc587332cc57fe7c357"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e4bb614118524fc587332cc57fe7c357"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e4bb614118524fc587332cc57fe7c357"}]}] Aug 12 01:27:56.126118 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant: tempest-VolumesNegativeTest-1424139784 Aug 12 01:27:56.126118 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Id: e4bb614118524fc587332cc57fe7c357 Aug 12 01:27:56.126118 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Name: tempest-VolumesNegativeTest-1424139784 Aug 12 01:27:56.126118 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User: tempest-VolumesNegativeTest-1424139784-project Aug 12 01:27:56.126118 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Id: default Aug 12 01:27:56.126118 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Name: Default Aug 12 01:27:56.126118 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Id: 6527b9fe4dca4826b17e12f83eb4a992 Aug 12 01:27:56.126118 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Name: tempest-VolumesNegativeTest-1424139784-project Aug 12 01:27:56.126118 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Aug 12 01:27:56.126118 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-844963069", "metadata": {"Type": "work"}}} Aug 12 01:27:56.126118 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: method: Aug 12 01:27:56.126118 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 12 01:27:56.127629 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-844963069', 'metadata': {'Type': 'work'}}}} Aug 12 01:27:56.127629 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:27:56.127629 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:27:56.127629 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 12 01:27:56.127629 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 12 01:27:56.127629 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 12 01:27:56.127629 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise error Aug 12 01:27:56.127629 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 12 01:27:56.127629 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:27:56.127629 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 12 01:27:56.127629 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 12 01:27:56.127629 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:27:56.127629 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 12 01:27:56.127629 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi '' Aug 12 01:27:56.127629 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:27:56.127629 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:27:56.127629 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:27:56.127629 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:27:56.127629 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:27:56.127629 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:27:56.127629 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:27:56.127629 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:27:56.129191 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 01:27:56.129191 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 01:27:56.129191 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:27:56.129191 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:27:56.129191 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 12 01:27:56.129191 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 12 01:27:56.129191 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 12 01:27:56.129191 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 12 01:27:56.129191 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 12 01:27:56.129191 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 12 01:27:56.129191 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 12 01:27:56.129191 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:27:56.129191 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:27:56.129191 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:27:56.129191 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:27:56.129191 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:27:56.129191 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:27:56.129191 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 12 01:27:56.129191 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 12 01:27:56.130603 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 12 01:27:56.130603 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:27:56.130603 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-0027b58a-9390-4124-8283-10b351c7217c tempest-VolumesNegativeTest-1424139784 tempest-VolumesNegativeTest-1424139784-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:27:56.130603 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-0027b58a-9390-4124-8283-10b351c7217c tempest-VolumesNegativeTest-1424139784 tempest-VolumesNegativeTest-1424139784-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010094 Aug 12 01:27:56.136296 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-00d41e22-4261-4765-9beb-36890af7d470 tempest-VolumesNegativeTest-1424139784 tempest-VolumesNegativeTest-1424139784-project] Calling method '.version_select at 0x7f2deef2cf70>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:27:56.137315 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 2/3] 10.222.0.20 () {60 vars in 1156 bytes} [Fri Aug 12 01:27:56 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 12 01:27:56.654543 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.wsgi [None req-00d41e22-4261-4765-9beb-36890af7d470 tempest-VolumesNegativeTest-1424139784 tempest-VolumesNegativeTest-1424139784-project] HTTP exception thrown: Volume tempest-invalid-1777868366 could not be found. Aug 12 01:27:56.658333 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-00d41e22-4261-4765-9beb-36890af7d470 tempest-VolumesNegativeTest-1424139784 tempest-VolumesNegativeTest-1424139784-project] Request method failure captured: Aug 12 01:27:56.658333 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1777868366 HTTP/1.1 Aug 12 01:27:56.658333 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept: application/json Aug 12 01:27:56.658333 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept-Encoding: identity Aug 12 01:27:56.658333 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Connection: close Aug 12 01:27:56.658333 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Length: 0 Aug 12 01:27:56.658333 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Type: application/json Aug 12 01:27:56.658333 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Host: 10.222.0.20 Aug 12 01:27:56.658333 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Openstack-System-Scope: None Aug 12 01:27:56.658333 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: User-Agent: python-urllib3/1.26.11 Aug 12 01:27:56.658333 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Auth-Token: gAAAAABi9ayaiY2Cr26nvm1YNJz968-BdMjTPR8k3wlg1OyQK_dWS2WpJeZ8e_gaTOEfX6kN3PeTSiDuM_D3_WTBozbi4KtVnydoMK2AVHkm7-3h0G8dxCSHEbIByTh1S_nczTv684IVJYJxTatFfn3KKVInm_HzThODd4Vz4vgA-ZXovV5QNLc Aug 12 01:27:56.658333 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Id: None Aug 12 01:27:56.658333 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Name: None Aug 12 01:27:56.658333 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Identity-Status: Confirmed Aug 12 01:27:56.658333 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Is-Admin-Project: True Aug 12 01:27:56.658333 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Id: default Aug 12 01:27:56.658333 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Name: Default Aug 12 01:27:56.658333 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Id: e4bb614118524fc587332cc57fe7c357 Aug 12 01:27:56.658333 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Name: tempest-VolumesNegativeTest-1424139784 Aug 12 01:27:56.658333 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Role: member,reader Aug 12 01:27:56.658333 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Roles: member,reader Aug 12 01:27:56.660021 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e4bb614118524fc587332cc57fe7c357"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e4bb614118524fc587332cc57fe7c357"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e4bb614118524fc587332cc57fe7c357"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e4bb614118524fc587332cc57fe7c357"}]}] Aug 12 01:27:56.660021 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant: tempest-VolumesNegativeTest-1424139784 Aug 12 01:27:56.660021 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Id: e4bb614118524fc587332cc57fe7c357 Aug 12 01:27:56.660021 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Name: tempest-VolumesNegativeTest-1424139784 Aug 12 01:27:56.660021 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User: tempest-VolumesNegativeTest-1424139784-project Aug 12 01:27:56.660021 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Id: default Aug 12 01:27:56.660021 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Name: Default Aug 12 01:27:56.660021 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Id: 6527b9fe4dca4826b17e12f83eb4a992 Aug 12 01:27:56.660021 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Name: tempest-VolumesNegativeTest-1424139784-project Aug 12 01:27:56.660021 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: method: Aug 12 01:27:56.660021 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: exception: Volume tempest-invalid-1777868366 could not be found. Aug 12 01:27:56.660021 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: action_args: {'id': 'tempest-invalid-1777868366'} Aug 12 01:27:56.660021 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:27:56.660953 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:27:56.660953 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 01:27:56.660953 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 01:27:56.660953 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 12 01:27:56.660953 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 12 01:27:56.660953 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 12 01:27:56.660953 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 12 01:27:56.660953 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 12 01:27:56.660953 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 12 01:27:56.660953 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 12 01:27:56.660953 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 12 01:27:56.660953 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 01:27:56.660953 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 01:27:56.660953 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 01:27:56.660953 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 01:27:56.660953 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1777868366 could not be found. (HTTP 404) (Request-ID: req-04bef6ed-2c5b-4dac-b4dd-a819770cd0e0) Aug 12 01:27:56.660953 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:27:56.660953 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:27:56.660953 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:27:56.662401 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:27:56.662401 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 12 01:27:56.662401 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 12 01:27:56.662401 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 01:27:56.662401 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 01:27:56.662401 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 12 01:27:56.662401 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 12 01:27:56.662401 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 01:27:56.662401 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 01:27:56.662401 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 01:27:56.662401 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 01:27:56.662401 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 12 01:27:56.662401 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 12 01:27:56.662401 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 12 01:27:56.662401 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 12 01:27:56.662401 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 12 01:27:56.662401 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 12 01:27:56.662401 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 12 01:27:56.662401 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 12 01:27:56.663670 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 01:27:56.663670 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 01:27:56.663670 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 01:27:56.663670 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 01:27:56.663670 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1777868366 could not be found. Aug 12 01:27:56.663670 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:27:56.663670 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:27:56.663670 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:27:56.663670 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:27:56.663670 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:27:56.663670 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:27:56.663670 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:27:56.663670 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:27:56.663670 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 01:27:56.663670 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 01:27:56.663670 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:27:56.663670 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:27:56.663670 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 12 01:27:56.663670 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:27:56.663670 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1777868366 could not be found. Aug 12 01:27:56.664980 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:27:56.664980 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:27:56.664980 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:27:56.664980 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:27:56.664980 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:27:56.664980 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:27:56.664980 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:27:56.664980 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:27:56.664980 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1777868366 could not be found. Aug 12 01:27:56.664980 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:27:56.664980 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-00d41e22-4261-4765-9beb-36890af7d470 tempest-VolumesNegativeTest-1424139784 tempest-VolumesNegativeTest-1424139784-project] Returning 404 to user: Volume tempest-invalid-1777868366 could not be found. {{(pid=120786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:27:56.664980 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-00d41e22-4261-4765-9beb-36890af7d470 tempest-VolumesNegativeTest-1424139784 tempest-VolumesNegativeTest-1424139784-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1777868366" status: 404 len: 99 microversion: 2.1 time: 0.529431 Aug 12 01:27:56.668695 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1218 bytes} [Fri Aug 12 01:27:56 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1777868366 => generated 99 bytes in 538 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 12 01:27:56.679640 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-38110671-58d0-48cc-9054-519ece54effd tempest-VolumesNegativeTest-1424139784 tempest-VolumesNegativeTest-1424139784-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006833 Aug 12 01:27:56.680817 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 3/5] 10.222.0.20 () {58 vars in 1140 bytes} [Fri Aug 12 01:27:56 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 12 01:27:56.690982 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-bfffbc5c-7e75-4df9-aa57-e1818cc1e244 tempest-VolumesNegativeTest-1424139784 tempest-VolumesNegativeTest-1424139784-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004514 Aug 12 01:27:56.691633 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 3/6] 10.222.0.20 () {58 vars in 1137 bytes} [Fri Aug 12 01:27:56 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 12 01:27:56.704848 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-fc1a8649-2e06-432e-9e67-c4397b5816ac tempest-VolumesNegativeTest-1424139784 tempest-VolumesNegativeTest-1424139784-project] Calling method '.version_select at 0x7f2deed96af0>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:27:56.986579 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-7a929998-dd3e-477d-9cd3-fc8d09290425 tempest-VolumesTestJSON-77352979 tempest-VolumesTestJSON-77352979-project] Calling method '.version_select at 0x7f2def708ee0>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:27:57.060982 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.wsgi [None req-fc1a8649-2e06-432e-9e67-c4397b5816ac tempest-VolumesNegativeTest-1424139784 tempest-VolumesNegativeTest-1424139784-project] HTTP exception thrown: Volume 2469f790-2ab6-4191-a957-abefaaed1100 could not be found. Aug 12 01:27:57.067921 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-fc1a8649-2e06-432e-9e67-c4397b5816ac tempest-VolumesNegativeTest-1424139784 tempest-VolumesNegativeTest-1424139784-project] Request method failure captured: Aug 12 01:27:57.067921 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: request: DELETE /compute/v2.1/os-volumes/2469f790-2ab6-4191-a957-abefaaed1100 HTTP/1.1 Aug 12 01:27:57.067921 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept: application/json Aug 12 01:27:57.067921 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept-Encoding: identity Aug 12 01:27:57.067921 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Connection: close Aug 12 01:27:57.067921 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Length: 0 Aug 12 01:27:57.067921 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Type: application/json Aug 12 01:27:57.067921 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Host: 10.222.0.20 Aug 12 01:27:57.067921 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Openstack-System-Scope: None Aug 12 01:27:57.067921 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: User-Agent: python-urllib3/1.26.11 Aug 12 01:27:57.067921 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Auth-Token: gAAAAABi9ayaiY2Cr26nvm1YNJz968-BdMjTPR8k3wlg1OyQK_dWS2WpJeZ8e_gaTOEfX6kN3PeTSiDuM_D3_WTBozbi4KtVnydoMK2AVHkm7-3h0G8dxCSHEbIByTh1S_nczTv684IVJYJxTatFfn3KKVInm_HzThODd4Vz4vgA-ZXovV5QNLc Aug 12 01:27:57.067921 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Id: None Aug 12 01:27:57.067921 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Name: None Aug 12 01:27:57.067921 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Identity-Status: Confirmed Aug 12 01:27:57.067921 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Is-Admin-Project: True Aug 12 01:27:57.067921 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Id: default Aug 12 01:27:57.067921 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Name: Default Aug 12 01:27:57.067921 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Id: e4bb614118524fc587332cc57fe7c357 Aug 12 01:27:57.067921 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Name: tempest-VolumesNegativeTest-1424139784 Aug 12 01:27:57.067921 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Role: member,reader Aug 12 01:27:57.067921 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Roles: member,reader Aug 12 01:27:57.069614 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e4bb614118524fc587332cc57fe7c357"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e4bb614118524fc587332cc57fe7c357"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e4bb614118524fc587332cc57fe7c357"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e4bb614118524fc587332cc57fe7c357"}]}] Aug 12 01:27:57.069614 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant: tempest-VolumesNegativeTest-1424139784 Aug 12 01:27:57.069614 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Id: e4bb614118524fc587332cc57fe7c357 Aug 12 01:27:57.069614 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Name: tempest-VolumesNegativeTest-1424139784 Aug 12 01:27:57.069614 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User: tempest-VolumesNegativeTest-1424139784-project Aug 12 01:27:57.069614 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Id: default Aug 12 01:27:57.069614 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Name: Default Aug 12 01:27:57.069614 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Id: 6527b9fe4dca4826b17e12f83eb4a992 Aug 12 01:27:57.069614 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Name: tempest-VolumesNegativeTest-1424139784-project Aug 12 01:27:57.069614 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: method: Aug 12 01:27:57.069614 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: exception: Volume 2469f790-2ab6-4191-a957-abefaaed1100 could not be found. Aug 12 01:27:57.069614 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: action_args: {'id': '2469f790-2ab6-4191-a957-abefaaed1100'} Aug 12 01:27:57.069614 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:27:57.070464 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:27:57.070464 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 01:27:57.070464 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 01:27:57.070464 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 12 01:27:57.070464 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 12 01:27:57.070464 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 12 01:27:57.070464 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 12 01:27:57.070464 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 12 01:27:57.070464 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 12 01:27:57.070464 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 12 01:27:57.070464 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 12 01:27:57.070464 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 01:27:57.070464 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 01:27:57.070464 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 01:27:57.070464 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 01:27:57.070464 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2469f790-2ab6-4191-a957-abefaaed1100 could not be found. (HTTP 404) (Request-ID: req-ba750805-366f-4ed0-a7a6-087bef3f0ed0) Aug 12 01:27:57.070464 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:27:57.070464 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:27:57.070464 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:27:57.071561 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:27:57.071561 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 12 01:27:57.071561 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 12 01:27:57.071561 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 01:27:57.071561 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 01:27:57.071561 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 12 01:27:57.071561 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 12 01:27:57.071561 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 01:27:57.071561 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 01:27:57.071561 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 01:27:57.071561 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 01:27:57.071561 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 12 01:27:57.071561 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 12 01:27:57.071561 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 12 01:27:57.071561 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 12 01:27:57.071561 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 12 01:27:57.071561 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 12 01:27:57.071561 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 12 01:27:57.071561 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 12 01:27:57.074800 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 01:27:57.074800 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 01:27:57.074800 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 01:27:57.074800 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 01:27:57.074800 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2469f790-2ab6-4191-a957-abefaaed1100 could not be found. Aug 12 01:27:57.074800 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:27:57.074800 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:27:57.074800 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:27:57.074800 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:27:57.074800 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:27:57.074800 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:27:57.074800 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:27:57.074800 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:27:57.074800 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 01:27:57.074800 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 01:27:57.074800 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:27:57.074800 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:27:57.074800 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 12 01:27:57.074800 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:27:57.077058 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2469f790-2ab6-4191-a957-abefaaed1100 could not be found. Aug 12 01:27:57.077058 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:27:57.077058 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:27:57.077058 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:27:57.077058 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:27:57.077058 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:27:57.077058 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:27:57.077058 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:27:57.077058 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:27:57.077058 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2469f790-2ab6-4191-a957-abefaaed1100 could not be found. Aug 12 01:27:57.077058 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:27:57.077058 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-fc1a8649-2e06-432e-9e67-c4397b5816ac tempest-VolumesNegativeTest-1424139784 tempest-VolumesNegativeTest-1424139784-project] Returning 404 to user: Volume 2469f790-2ab6-4191-a957-abefaaed1100 could not be found. {{(pid=120785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:27:57.077058 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-fc1a8649-2e06-432e-9e67-c4397b5816ac tempest-VolumesNegativeTest-1424139784 tempest-VolumesNegativeTest-1424139784-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/2469f790-2ab6-4191-a957-abefaaed1100" status: 404 len: 109 microversion: 2.1 time: 0.372853 Aug 12 01:27:57.077058 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Aug 12 01:27:56 2022] DELETE /compute/v2.1/os-volumes/2469f790-2ab6-4191-a957-abefaaed1100 => generated 109 bytes in 376 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:27:57.086257 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-ab917497-a9aa-41b8-a894-fd15aac7e380 tempest-VolumesNegativeTest-1424139784 tempest-VolumesNegativeTest-1424139784-project] Calling method '.version_select at 0x7f2deecce700>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:27:57.087714 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-7a929998-dd3e-477d-9cd3-fc8d09290425 tempest-VolumesTestJSON-77352979 tempest-VolumesTestJSON-77352979-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/6bc24cd2-e866-4873-be74-efe78c6c6bfe" status: 200 len: 351 microversion: 2.1 time: 0.102538 Aug 12 01:27:57.088423 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Aug 12 01:27:56 2022] GET /compute/v2.1/os-volumes/6bc24cd2-e866-4873-be74-efe78c6c6bfe => generated 351 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 01:27:57.146382 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.wsgi [None req-ab917497-a9aa-41b8-a894-fd15aac7e380 tempest-VolumesNegativeTest-1424139784 tempest-VolumesNegativeTest-1424139784-project] HTTP exception thrown: Volume 2086a1bc-f78f-48df-908a-56daf3e52fbe could not be found. Aug 12 01:27:57.149052 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-ab917497-a9aa-41b8-a894-fd15aac7e380 tempest-VolumesNegativeTest-1424139784 tempest-VolumesNegativeTest-1424139784-project] Request method failure captured: Aug 12 01:27:57.149052 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: request: GET /compute/v2.1/os-volumes/2086a1bc-f78f-48df-908a-56daf3e52fbe HTTP/1.1 Aug 12 01:27:57.149052 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept: application/json Aug 12 01:27:57.149052 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept-Encoding: identity Aug 12 01:27:57.149052 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Connection: close Aug 12 01:27:57.149052 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Length: 0 Aug 12 01:27:57.149052 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Type: application/json Aug 12 01:27:57.149052 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Host: 10.222.0.20 Aug 12 01:27:57.149052 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Openstack-System-Scope: None Aug 12 01:27:57.149052 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: User-Agent: python-urllib3/1.26.11 Aug 12 01:27:57.149052 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Auth-Token: gAAAAABi9ayaiY2Cr26nvm1YNJz968-BdMjTPR8k3wlg1OyQK_dWS2WpJeZ8e_gaTOEfX6kN3PeTSiDuM_D3_WTBozbi4KtVnydoMK2AVHkm7-3h0G8dxCSHEbIByTh1S_nczTv684IVJYJxTatFfn3KKVInm_HzThODd4Vz4vgA-ZXovV5QNLc Aug 12 01:27:57.149052 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Id: None Aug 12 01:27:57.149052 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Name: None Aug 12 01:27:57.149052 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Identity-Status: Confirmed Aug 12 01:27:57.149052 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Is-Admin-Project: True Aug 12 01:27:57.149052 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Id: default Aug 12 01:27:57.149052 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Name: Default Aug 12 01:27:57.149052 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Id: e4bb614118524fc587332cc57fe7c357 Aug 12 01:27:57.149052 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Name: tempest-VolumesNegativeTest-1424139784 Aug 12 01:27:57.149052 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Role: member,reader Aug 12 01:27:57.149052 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Roles: member,reader Aug 12 01:27:57.151675 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e4bb614118524fc587332cc57fe7c357"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e4bb614118524fc587332cc57fe7c357"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e4bb614118524fc587332cc57fe7c357"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e4bb614118524fc587332cc57fe7c357"}]}] Aug 12 01:27:57.151675 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant: tempest-VolumesNegativeTest-1424139784 Aug 12 01:27:57.151675 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Id: e4bb614118524fc587332cc57fe7c357 Aug 12 01:27:57.151675 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Name: tempest-VolumesNegativeTest-1424139784 Aug 12 01:27:57.151675 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User: tempest-VolumesNegativeTest-1424139784-project Aug 12 01:27:57.151675 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Id: default Aug 12 01:27:57.151675 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Name: Default Aug 12 01:27:57.151675 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Id: 6527b9fe4dca4826b17e12f83eb4a992 Aug 12 01:27:57.151675 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Name: tempest-VolumesNegativeTest-1424139784-project Aug 12 01:27:57.151675 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: method: Aug 12 01:27:57.151675 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: exception: Volume 2086a1bc-f78f-48df-908a-56daf3e52fbe could not be found. Aug 12 01:27:57.151675 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: action_args: {'id': '2086a1bc-f78f-48df-908a-56daf3e52fbe'} Aug 12 01:27:57.151675 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:27:57.152783 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:27:57.152783 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 01:27:57.152783 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 01:27:57.152783 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 01:27:57.152783 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 01:27:57.152783 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 01:27:57.152783 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 01:27:57.152783 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 01:27:57.152783 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 01:27:57.152783 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 01:27:57.152783 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 01:27:57.152783 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 01:27:57.152783 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 01:27:57.152783 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 01:27:57.152783 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 01:27:57.152783 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2086a1bc-f78f-48df-908a-56daf3e52fbe could not be found. (HTTP 404) (Request-ID: req-25368fd7-37da-4685-8de2-5dfe6bccdee2) Aug 12 01:27:57.152783 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:27:57.152783 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:27:57.152783 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:27:57.154988 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:27:57.154988 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 12 01:27:57.154988 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 12 01:27:57.154988 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 01:27:57.154988 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 01:27:57.154988 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 12 01:27:57.154988 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 12 01:27:57.154988 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 01:27:57.154988 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 01:27:57.154988 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 01:27:57.154988 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 01:27:57.154988 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 01:27:57.154988 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 01:27:57.154988 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 01:27:57.154988 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 01:27:57.154988 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 01:27:57.154988 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 01:27:57.154988 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 01:27:57.154988 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 01:27:57.158486 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 01:27:57.158486 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 01:27:57.158486 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 01:27:57.158486 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 01:27:57.158486 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2086a1bc-f78f-48df-908a-56daf3e52fbe could not be found. Aug 12 01:27:57.158486 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:27:57.158486 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:27:57.158486 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:27:57.158486 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:27:57.158486 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:27:57.158486 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:27:57.158486 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:27:57.158486 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:27:57.158486 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 01:27:57.158486 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 01:27:57.158486 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:27:57.158486 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:27:57.158486 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 12 01:27:57.158486 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:27:57.162199 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2086a1bc-f78f-48df-908a-56daf3e52fbe could not be found. Aug 12 01:27:57.162199 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:27:57.162199 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:27:57.162199 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:27:57.162199 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:27:57.162199 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:27:57.162199 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:27:57.162199 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:27:57.162199 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:27:57.162199 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2086a1bc-f78f-48df-908a-56daf3e52fbe could not be found. Aug 12 01:27:57.162199 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:27:57.162199 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-ab917497-a9aa-41b8-a894-fd15aac7e380 tempest-VolumesNegativeTest-1424139784 tempest-VolumesNegativeTest-1424139784-project] Returning 404 to user: Volume 2086a1bc-f78f-48df-908a-56daf3e52fbe could not be found. {{(pid=120785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:27:57.162199 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-ab917497-a9aa-41b8-a894-fd15aac7e380 tempest-VolumesNegativeTest-1424139784 tempest-VolumesNegativeTest-1424139784-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2086a1bc-f78f-48df-908a-56daf3e52fbe" status: 404 len: 109 microversion: 2.1 time: 0.074565 Aug 12 01:27:57.173052 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 5/9] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Aug 12 01:27:57 2022] GET /compute/v2.1/os-volumes/2086a1bc-f78f-48df-908a-56daf3e52fbe => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:27:59.212925 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-eda35227-ea65-448c-b09a-2d192d8f1837 tempest-VolumesTestJSON-77352979 tempest-VolumesTestJSON-77352979-project] Calling method '.version_select at 0x7f2deecc6820>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:27:59.334196 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-eda35227-ea65-448c-b09a-2d192d8f1837 tempest-VolumesTestJSON-77352979 tempest-VolumesTestJSON-77352979-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/cf065fcd-3b6b-4419-80d6-033989422a37" status: 200 len: 351 microversion: 2.1 time: 0.125081 Aug 12 01:27:59.342640 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 5/10] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Aug 12 01:27:59 2022] GET /compute/v2.1/os-volumes/cf065fcd-3b6b-4419-80d6-033989422a37 => generated 351 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:28:01.048987 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-bd32a8b0-4dcd-402a-bdd9-30bb1ef561dc tempest-VolumesTestJSON-77352979 tempest-VolumesTestJSON-77352979-project] Calling method '.version_select at 0x7f2deecce280>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:01.147512 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-bd32a8b0-4dcd-402a-bdd9-30bb1ef561dc tempest-VolumesTestJSON-77352979 tempest-VolumesTestJSON-77352979-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/c9602c8a-2d50-4179-b686-1344f9bf9368" status: 200 len: 350 microversion: 2.1 time: 0.103562 Aug 12 01:28:01.155422 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 6/11] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Aug 12 01:28:01 2022] GET /compute/v2.1/os-volumes/c9602c8a-2d50-4179-b686-1344f9bf9368 => generated 350 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:28:01.161844 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-a1662f53-4315-4685-9c34-c8a75d848bc1 tempest-VolumesTestJSON-77352979 tempest-VolumesTestJSON-77352979-project] Calling method '.version_select at 0x7f2deecc6ee0>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:01.323477 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-a1662f53-4315-4685-9c34-c8a75d848bc1 tempest-VolumesTestJSON-77352979 tempest-VolumesTestJSON-77352979-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.164523 Aug 12 01:28:01.324287 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1134 bytes} [Fri Aug 12 01:28:01 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:01.350633 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-e0c05acb-b963-4ed9-aefb-4f1d459cfd60 tempest-VolumesTestJSON-77352979 tempest-VolumesTestJSON-77352979-project] Calling method '.version_select at 0x7f2deecce4c0>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:01.517548 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-e0c05acb-b963-4ed9-aefb-4f1d459cfd60 tempest-VolumesTestJSON-77352979 tempest-VolumesTestJSON-77352979-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.172781 Aug 12 01:28:01.518408 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1149 bytes} [Fri Aug 12 01:28:01 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:28:01.532263 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-7169c5a1-eced-495c-b92f-a64d6e7940d4 tempest-VolumesTestJSON-77352979 tempest-VolumesTestJSON-77352979-project] Calling method '.version_select at 0x7f2deecd0160>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:01.687627 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-7169c5a1-eced-495c-b92f-a64d6e7940d4 tempest-VolumesTestJSON-77352979 tempest-VolumesTestJSON-77352979-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.159390 Aug 12 01:28:01.688583 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 7/14] 10.222.0.20 () {58 vars in 1134 bytes} [Fri Aug 12 01:28:01 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:01.704135 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-a10ce092-53dd-4c4a-963d-89d905973ab2 tempest-VolumesTestJSON-77352979 tempest-VolumesTestJSON-77352979-project] Calling method '.version_select at 0x7f2deecddee0>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:01.846274 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-a10ce092-53dd-4c4a-963d-89d905973ab2 tempest-VolumesTestJSON-77352979 tempest-VolumesTestJSON-77352979-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.147098 Aug 12 01:28:01.861606 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 8/15] 10.222.0.20 () {58 vars in 1167 bytes} [Fri Aug 12 01:28:01 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:28:01.863635 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-1ff6afbf-a6f5-41f1-b298-a75210573625 tempest-VolumesTestJSON-77352979 tempest-VolumesTestJSON-77352979-project] Calling method '.version_select at 0x7f2deecce430>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:01.991208 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-1ff6afbf-a6f5-41f1-b298-a75210573625 tempest-VolumesTestJSON-77352979 tempest-VolumesTestJSON-77352979-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.133229 Aug 12 01:28:02.006911 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-dea6c3ed-ceba-42c5-8a51-2a21985aebff tempest-VolumesTestJSON-77352979 tempest-VolumesTestJSON-77352979-project] Calling method '.version_select at 0x7f2deecdd670>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:02.007580 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 8/16] 10.222.0.20 () {58 vars in 1170 bytes} [Fri Aug 12 01:28:01 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:28:02.121852 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-dea6c3ed-ceba-42c5-8a51-2a21985aebff tempest-VolumesTestJSON-77352979 tempest-VolumesTestJSON-77352979-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.117254 Aug 12 01:28:02.132751 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 9/17] 10.222.0.20 () {58 vars in 1155 bytes} [Fri Aug 12 01:28:02 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:02.138415 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-46dd8f5a-c31a-48a2-8d65-352a826334a9 tempest-VolumesTestJSON-77352979 tempest-VolumesTestJSON-77352979-project] Calling method '.version_select at 0x7f2deecc63a0>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:02.300555 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-46dd8f5a-c31a-48a2-8d65-352a826334a9 tempest-VolumesTestJSON-77352979 tempest-VolumesTestJSON-77352979-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.168103 Aug 12 01:28:02.302055 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 9/18] 10.222.0.20 () {58 vars in 1188 bytes} [Fri Aug 12 01:28:02 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:28:02.315356 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-dfdc5237-dc79-4c6d-9835-98632290ac3d tempest-VolumesTestJSON-77352979 tempest-VolumesTestJSON-77352979-project] Calling method '.version_select at 0x7f2deece15e0>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:02.505439 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-dfdc5237-dc79-4c6d-9835-98632290ac3d tempest-VolumesTestJSON-77352979 tempest-VolumesTestJSON-77352979-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.194105 Aug 12 01:28:02.506998 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 10/19] 10.222.0.20 () {58 vars in 1155 bytes} [Fri Aug 12 01:28:02 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:09.414809 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-0d504221-e39a-493b-9376-c6006a4d06ba tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-509186014", "imageRef": "0d77ae04-91a5-4e2b-8817-72986618c549", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:28:09.619260 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.network.neutron [None req-0d504221-e39a-493b-9376-c6006a4d06ba tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] validate_networks() for [('0d1de51b-a5d0-4a09-af82-8f44783003c3', None, None, None, None, None)] {{(pid=120786) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 01:28:13.165067 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-0d504221-e39a-493b-9376-c6006a4d06ba tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Flavor limits 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 01:28:13.166292 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-0d504221-e39a-493b-9376-c6006a4d06ba tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Image limits 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 01:28:13.166979 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-0d504221-e39a-493b-9376-c6006a4d06ba tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Flavor pref 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 01:28:13.167696 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-0d504221-e39a-493b-9376-c6006a4d06ba tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Image pref 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 01:28:13.168285 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-0d504221-e39a-493b-9376-c6006a4d06ba tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 01:28:13.208508 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0d504221-e39a-493b-9376-c6006a4d06ba tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:13.209056 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0d504221-e39a-493b-9376-c6006a4d06ba tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:13.209490 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0d504221-e39a-493b-9376-c6006a4d06ba tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:13.215151 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0d504221-e39a-493b-9376-c6006a4d06ba tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:13.215731 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0d504221-e39a-493b-9376-c6006a4d06ba tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:13.216172 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0d504221-e39a-493b-9376-c6006a4d06ba tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:13.346759 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.quota [None req-0d504221-e39a-493b-9376-c6006a4d06ba tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Getting quotas for project a0674e4f240748d69cc9be8fdc79ad89. Resources: {'cores', 'ram', 'instances'} {{(pid=120786) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 01:28:13.371362 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.quota [None req-0d504221-e39a-493b-9376-c6006a4d06ba tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Getting quotas for user fed1b143e80642328bb5c7c78cacedcd and project a0674e4f240748d69cc9be8fdc79ad89. Resources: {'cores', 'ram', 'instances'} {{(pid=120786) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 01:28:13.408498 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-0d504221-e39a-493b-9376-c6006a4d06ba tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Going to run 1 instances... {{(pid=120786) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 01:28:13.411471 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-0d504221-e39a-493b-9376-c6006a4d06ba tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 1e1a8df3-8078-437c-ab98-64d52e277263] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d77ae04-91a5-4e2b-8817-72986618c549',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120786) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 01:28:13.592951 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-0d504221-e39a-493b-9376-c6006a4d06ba tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.476231 Aug 12 01:28:13.593639 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 10/20] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 01:28:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 4478 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 12 01:28:13.622441 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-a71603b8-117b-491b-8df5-c3a8de718a6e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Action: 'create', calling method: .version_select at 0x7f2deece6af0>, body: {"keypair": {"name": "tempest-keypair-903954503", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZRSby4u6MkwZDJoNCJm7xNwWn75yowwMqxqQZ5gBXG9XtGS6PuRC8KFrMuAotlb0C1mlIwMBkK/9Nq+aVeZEYS6i693qUcuOj70D4XTW/ISpmrbTR2hWslfpLkb3r+rw=="}} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:28:13.762475 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.quota [None req-a71603b8-117b-491b-8df5-c3a8de718a6e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Getting quotas for project e5e2fd72103c4b5e956ef5b9c291f16d. Resources: {'key_pairs'} {{(pid=120785) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 01:28:13.778516 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.quota [None req-a71603b8-117b-491b-8df5-c3a8de718a6e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Getting quotas for user 4395876e1de944ae82d23d43a30a82a8 and project e5e2fd72103c4b5e956ef5b9c291f16d. Resources: {'key_pairs'} {{(pid=120785) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 01:28:13.876815 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-a71603b8-117b-491b-8df5-c3a8de718a6e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.967190 Aug 12 01:28:13.877733 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 11/21] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Aug 12 01:28:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 01:28:13.887038 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-d90a56e6-1431-4971-bbe8-377a24c27d79 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:13.888546 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-d90a56e6-1431-4971-bbe8-377a24c27d79 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 1e1a8df3-8078-437c-ab98-64d52e277263] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:14.075783 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-8b31ea05-3240-47d1-ae80-552d62327373 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Action: 'create', calling method: .version_select at 0x7f2dee3c8b80>, body: {"keypair": {"name": "tempest-keypair-788424551", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2RFDorSpMDbnEy2s7J6hhNUJTt9iH77hHyc00Ef4hmG66jvfe4/svDX2bT6apD3F8wq3Ybc4fYNe2yXSus9qQUkPFHol+Y7UBlGg+MYX2CwiJYPsF57Z57v5hM9h4I0Q=="}} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:28:14.137684 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.quota [None req-8b31ea05-3240-47d1-ae80-552d62327373 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Getting quotas for project 0cb834d06ed94c1993ec0f7130d97803. Resources: {'key_pairs'} {{(pid=120786) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 01:28:14.148755 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.quota [None req-8b31ea05-3240-47d1-ae80-552d62327373 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Getting quotas for user 605b0b202a3b44c7aa227c1b97193365 and project 0cb834d06ed94c1993ec0f7130d97803. Resources: {'key_pairs'} {{(pid=120786) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 01:28:14.231724 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-8b31ea05-3240-47d1-ae80-552d62327373 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.636811 Aug 12 01:28:14.233647 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 11/22] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Aug 12 01:28:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:28:14.340524 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-d90a56e6-1431-4971-bbe8-377a24c27d79 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:14.372491 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-d90a56e6-1431-4971-bbe8-377a24c27d79 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263" status: 200 len: 1221 microversion: 2.1 time: 0.493286 Aug 12 01:28:14.378095 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 12/23] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:13 2022] GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263 => generated 1221 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:15.042425 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-f19088f3-29ff-4fd6-8d90-1c85e20a763d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1651472600", "imageRef": "0d77ae04-91a5-4e2b-8817-72986618c549", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:28:15.330786 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.network.neutron [None req-f19088f3-29ff-4fd6-8d90-1c85e20a763d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] validate_networks() for [('0d1de51b-a5d0-4a09-af82-8f44783003c3', None, None, None, None, None)] {{(pid=120785) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 01:28:15.982548 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-91ed5368-0377-46a9-a147-797dec6778c1 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Action: 'create', calling method: .version_select at 0x7f2dedb80040>, body: {"keypair": {"name": "tempest-keypair-1819394950", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6t/HlxgQF7aG8pGrchs8g2J/yx3gihfHDT4UKBClRQ0MzDb85VfmmBTVVHjV9aJkLcyx+fOCYmO4Q+r/I1o+Wlmfhk8NhVJgzA0Y0P6EzNlut8nfPO7a5JYVaaWSCq4Q=="}} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:28:16.037377 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.quota [None req-91ed5368-0377-46a9-a147-797dec6778c1 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Getting quotas for project 9d33b640693442238516535af8320529. Resources: {'key_pairs'} {{(pid=120786) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 01:28:16.060945 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.quota [None req-91ed5368-0377-46a9-a147-797dec6778c1 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Getting quotas for user be3709a7f73442e79e7d5ad0c9389ac1 and project 9d33b640693442238516535af8320529. Resources: {'key_pairs'} {{(pid=120786) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 01:28:16.126160 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-91ed5368-0377-46a9-a147-797dec6778c1 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.299413 Aug 12 01:28:16.127243 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 12/24] 10.222.0.20 () {62 vars in 1200 bytes} [Fri Aug 12 01:28:14 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1301 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 12 01:28:16.846802 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-a7b9ee87-8d08-4efd-9935-04fcf749350a tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2009602329", "imageRef": "0d77ae04-91a5-4e2b-8817-72986618c549", "flavorRef": "452", "networks": [{"uuid": "a06d250a-3f70-4fa5-8a58-5159fc388d07"}]}} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:28:17.001892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.network.neutron [None req-a7b9ee87-8d08-4efd-9935-04fcf749350a tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] validate_networks() for [('a06d250a-3f70-4fa5-8a58-5159fc388d07', None, None, None, None, None)] {{(pid=120786) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 01:28:19.693736 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-f19088f3-29ff-4fd6-8d90-1c85e20a763d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Flavor limits 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 01:28:19.694182 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-f19088f3-29ff-4fd6-8d90-1c85e20a763d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Image limits 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 01:28:19.694541 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-f19088f3-29ff-4fd6-8d90-1c85e20a763d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Flavor pref 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 01:28:19.695013 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-f19088f3-29ff-4fd6-8d90-1c85e20a763d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Image pref 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 01:28:19.696999 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-f19088f3-29ff-4fd6-8d90-1c85e20a763d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 01:28:19.730352 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f19088f3-29ff-4fd6-8d90-1c85e20a763d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:19.731728 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f19088f3-29ff-4fd6-8d90-1c85e20a763d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:19.733063 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f19088f3-29ff-4fd6-8d90-1c85e20a763d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:19.734126 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f19088f3-29ff-4fd6-8d90-1c85e20a763d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:19.737986 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f19088f3-29ff-4fd6-8d90-1c85e20a763d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:19.738871 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f19088f3-29ff-4fd6-8d90-1c85e20a763d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:19.814937 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.quota [None req-f19088f3-29ff-4fd6-8d90-1c85e20a763d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Getting quotas for project a0674e4f240748d69cc9be8fdc79ad89. Resources: {'cores', 'ram', 'instances'} {{(pid=120785) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 01:28:19.829062 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.quota [None req-f19088f3-29ff-4fd6-8d90-1c85e20a763d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Getting quotas for user fed1b143e80642328bb5c7c78cacedcd and project a0674e4f240748d69cc9be8fdc79ad89. Resources: {'cores', 'ram', 'instances'} {{(pid=120785) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 01:28:19.888212 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-f19088f3-29ff-4fd6-8d90-1c85e20a763d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Going to run 1 instances... {{(pid=120785) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 01:28:19.902701 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-f19088f3-29ff-4fd6-8d90-1c85e20a763d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d77ae04-91a5-4e2b-8817-72986618c549',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120785) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 01:28:20.141853 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-f19088f3-29ff-4fd6-8d90-1c85e20a763d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.104098 Aug 12 01:28:20.143230 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 13/25] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 01:28:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 5117 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 01:28:20.168181 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-1a08014c-de9d-4140-b306-47ca44b6a5e4 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:20.168837 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-1a08014c-de9d-4140-b306-47ca44b6a5e4 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:20.495006 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-1a08014c-de9d-4140-b306-47ca44b6a5e4 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:20.512546 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-1a08014c-de9d-4140-b306-47ca44b6a5e4 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1222 microversion: 2.1 time: 0.361391 Aug 12 01:28:20.520639 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 14/26] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:20 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1222 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:20.651410 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-a7b9ee87-8d08-4efd-9935-04fcf749350a tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Flavor limits 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 01:28:20.651946 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-a7b9ee87-8d08-4efd-9935-04fcf749350a tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Image limits 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 01:28:20.652701 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-a7b9ee87-8d08-4efd-9935-04fcf749350a tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Flavor pref 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 01:28:20.655454 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-a7b9ee87-8d08-4efd-9935-04fcf749350a tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Image pref 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 01:28:20.655454 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-a7b9ee87-8d08-4efd-9935-04fcf749350a tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 01:28:20.675139 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a7b9ee87-8d08-4efd-9935-04fcf749350a tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:20.684567 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a7b9ee87-8d08-4efd-9935-04fcf749350a tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:20.698861 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a7b9ee87-8d08-4efd-9935-04fcf749350a tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:20.703504 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a7b9ee87-8d08-4efd-9935-04fcf749350a tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:20.704069 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a7b9ee87-8d08-4efd-9935-04fcf749350a tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:20.707900 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a7b9ee87-8d08-4efd-9935-04fcf749350a tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:20.850076 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.quota [None req-a7b9ee87-8d08-4efd-9935-04fcf749350a tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Getting quotas for project 7cf0858834c84aaa993de55f361d6ed9. Resources: {'cores', 'ram', 'instances'} {{(pid=120786) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 01:28:20.882109 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.quota [None req-a7b9ee87-8d08-4efd-9935-04fcf749350a tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Getting quotas for user 023a04369b394bd1b035ab793e0b93b0 and project 7cf0858834c84aaa993de55f361d6ed9. Resources: {'cores', 'ram', 'instances'} {{(pid=120786) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 01:28:20.963042 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-a7b9ee87-8d08-4efd-9935-04fcf749350a tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Going to run 1 instances... {{(pid=120786) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 01:28:20.970887 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-a7b9ee87-8d08-4efd-9935-04fcf749350a tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] [instance: 26be209b-84c3-49e2-a869-ea8c00f94851] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d77ae04-91a5-4e2b-8817-72986618c549',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120786) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 01:28:21.230503 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-a7b9ee87-8d08-4efd-9935-04fcf749350a tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.101820 Aug 12 01:28:21.231157 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 13/27] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 01:28:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 5103 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 01:28:21.243418 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-b772c4ee-5432-48c1-af99-efa0f805fa97 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:21.244181 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-b772c4ee-5432-48c1-af99-efa0f805fa97 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] [instance: 26be209b-84c3-49e2-a869-ea8c00f94851] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:21.541579 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-3b0f74ae-ab5f-498b-b609-4269a3466756 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:21.542248 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-3b0f74ae-ab5f-498b-b609-4269a3466756 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:21.614226 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-b772c4ee-5432-48c1-af99-efa0f805fa97 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023a04369b394bd1b035ab793e0b93b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf0858834c84aaa993de55f361d6ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:21.624039 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-b772c4ee-5432-48c1-af99-efa0f805fa97 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] 10.222.0.20 "GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851" status: 200 len: 1215 microversion: 2.1 time: 0.384585 Aug 12 01:28:21.645052 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 15/28] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:21 2022] GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851 => generated 1215 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:21.826589 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-3b0f74ae-ab5f-498b-b609-4269a3466756 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:21.870614 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-3b0f74ae-ab5f-498b-b609-4269a3466756 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1222 microversion: 2.1 time: 0.333389 Aug 12 01:28:21.871371 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 14/29] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:21 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1222 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:22.533361 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-6ae7f0cd-da90-4395-a229-22475e762e92 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-377365753", "imageRef": "0d77ae04-91a5-4e2b-8817-72986618c549", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c945ad6e-d04a-40d2-b591-3e29f6e664bb"}], "security_groups": [{"name": "tempest-securitygroup--1826246249"}], "key_name": "tempest-keypair-788424551", "user_data": "}} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:28:22.668014 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-0e09207e-eae1-4a16-9d63-9a3557752c1d tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:22.669306 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-0e09207e-eae1-4a16-9d63-9a3557752c1d tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] [instance: 26be209b-84c3-49e2-a869-ea8c00f94851] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:22.886148 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.network.neutron [None req-6ae7f0cd-da90-4395-a229-22475e762e92 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] validate_networks() for [('c945ad6e-d04a-40d2-b591-3e29f6e664bb', None, None, None, None, None)] {{(pid=120785) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 01:28:23.142515 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-0e09207e-eae1-4a16-9d63-9a3557752c1d tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023a04369b394bd1b035ab793e0b93b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf0858834c84aaa993de55f361d6ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:23.149875 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-0e09207e-eae1-4a16-9d63-9a3557752c1d tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] 10.222.0.20 "GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851" status: 200 len: 1215 microversion: 2.1 time: 0.486086 Aug 12 01:28:23.150454 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 15/30] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:22 2022] GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851 => generated 1215 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:28:23.157283 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-a1406810-3e34-4c8f-93e9-e75bab107cc4 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:23.161427 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-a1406810-3e34-4c8f-93e9-e75bab107cc4 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:23.199836 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a1406810-3e34-4c8f-93e9-e75bab107cc4 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:23.200347 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a1406810-3e34-4c8f-93e9-e75bab107cc4 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:23.207781 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a1406810-3e34-4c8f-93e9-e75bab107cc4 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:23.208930 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a1406810-3e34-4c8f-93e9-e75bab107cc4 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:23.212000 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a1406810-3e34-4c8f-93e9-e75bab107cc4 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:23.212612 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a1406810-3e34-4c8f-93e9-e75bab107cc4 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:24.084580 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-a1406810-3e34-4c8f-93e9-e75bab107cc4 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:24.138472 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-a1406810-3e34-4c8f-93e9-e75bab107cc4 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1274 microversion: 2.1 time: 0.985307 Aug 12 01:28:24.146217 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 16/31] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:23 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1274 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:24.179580 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-d00208ca-b190-4802-b857-6239471d0713 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:24.180247 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-d00208ca-b190-4802-b857-6239471d0713 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] [instance: 26be209b-84c3-49e2-a869-ea8c00f94851] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:24.221636 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d00208ca-b190-4802-b857-6239471d0713 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:24.222253 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d00208ca-b190-4802-b857-6239471d0713 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:24.222706 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d00208ca-b190-4802-b857-6239471d0713 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:24.223422 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d00208ca-b190-4802-b857-6239471d0713 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:24.236179 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d00208ca-b190-4802-b857-6239471d0713 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:24.238440 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d00208ca-b190-4802-b857-6239471d0713 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:24.771341 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-d00208ca-b190-4802-b857-6239471d0713 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023a04369b394bd1b035ab793e0b93b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf0858834c84aaa993de55f361d6ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:24.801453 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-d00208ca-b190-4802-b857-6239471d0713 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] 10.222.0.20 "GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851" status: 200 len: 1267 microversion: 2.1 time: 0.620987 Aug 12 01:28:24.808004 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 17/32] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:24 2022] GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851 => generated 1267 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:24.999496 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-6ae7f0cd-da90-4395-a229-22475e762e92 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Flavor limits 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 01:28:25.004684 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-6ae7f0cd-da90-4395-a229-22475e762e92 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Image limits 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 01:28:25.005729 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-6ae7f0cd-da90-4395-a229-22475e762e92 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Flavor pref 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 01:28:25.006278 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-6ae7f0cd-da90-4395-a229-22475e762e92 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Image pref 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 01:28:25.006829 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-6ae7f0cd-da90-4395-a229-22475e762e92 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 01:28:25.038481 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6ae7f0cd-da90-4395-a229-22475e762e92 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:25.042304 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6ae7f0cd-da90-4395-a229-22475e762e92 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:25.045703 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6ae7f0cd-da90-4395-a229-22475e762e92 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:25.046655 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6ae7f0cd-da90-4395-a229-22475e762e92 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:25.050648 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6ae7f0cd-da90-4395-a229-22475e762e92 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:25.051288 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6ae7f0cd-da90-4395-a229-22475e762e92 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:25.163208 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-28ccf883-1dc8-49ff-9e22-19ea94e5ae09 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:25.168140 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-28ccf883-1dc8-49ff-9e22-19ea94e5ae09 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:25.203691 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.quota [None req-6ae7f0cd-da90-4395-a229-22475e762e92 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Getting quotas for project 0cb834d06ed94c1993ec0f7130d97803. Resources: {'cores', 'ram', 'instances'} {{(pid=120785) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 01:28:25.228179 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-28ccf883-1dc8-49ff-9e22-19ea94e5ae09 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:25.228669 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-28ccf883-1dc8-49ff-9e22-19ea94e5ae09 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:25.229239 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-28ccf883-1dc8-49ff-9e22-19ea94e5ae09 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:25.229963 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-28ccf883-1dc8-49ff-9e22-19ea94e5ae09 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:25.230414 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-28ccf883-1dc8-49ff-9e22-19ea94e5ae09 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:25.230836 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-28ccf883-1dc8-49ff-9e22-19ea94e5ae09 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:25.263008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.quota [None req-6ae7f0cd-da90-4395-a229-22475e762e92 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Getting quotas for user 605b0b202a3b44c7aa227c1b97193365 and project 0cb834d06ed94c1993ec0f7130d97803. Resources: {'cores', 'ram', 'instances'} {{(pid=120785) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 01:28:25.321247 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-6ae7f0cd-da90-4395-a229-22475e762e92 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Going to run 1 instances... {{(pid=120785) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 01:28:25.324736 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-6ae7f0cd-da90-4395-a229-22475e762e92 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d77ae04-91a5-4e2b-8817-72986618c549',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120785) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 01:28:25.447163 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-6ae7f0cd-da90-4395-a229-22475e762e92 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.918753 Aug 12 01:28:25.448174 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 16/33] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 01:28:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 2920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 01:28:25.459153 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-af2465ec-4362-42ae-b2e2-9dc6ee7953d3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:25.460049 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-af2465ec-4362-42ae-b2e2-9dc6ee7953d3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:25.652503 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-28ccf883-1dc8-49ff-9e22-19ea94e5ae09 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:25.665613 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-28ccf883-1dc8-49ff-9e22-19ea94e5ae09 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1280 microversion: 2.1 time: 0.505229 Aug 12 01:28:25.667521 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 18/34] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:25 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1280 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:25.827168 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-c8b1aede-5c9d-427d-a8ed-78b7a85775aa tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:25.830233 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-c8b1aede-5c9d-427d-a8ed-78b7a85775aa tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] [instance: 26be209b-84c3-49e2-a869-ea8c00f94851] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:25.843293 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-af2465ec-4362-42ae-b2e2-9dc6ee7953d3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:25.860041 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-af2465ec-4362-42ae-b2e2-9dc6ee7953d3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1236 microversion: 2.1 time: 0.404990 Aug 12 01:28:25.871419 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c8b1aede-5c9d-427d-a8ed-78b7a85775aa tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:25.874076 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c8b1aede-5c9d-427d-a8ed-78b7a85775aa tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:25.877586 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c8b1aede-5c9d-427d-a8ed-78b7a85775aa tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:25.880336 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c8b1aede-5c9d-427d-a8ed-78b7a85775aa tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:25.897896 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 17/35] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:25 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1236 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:25.903196 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c8b1aede-5c9d-427d-a8ed-78b7a85775aa tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:25.907406 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c8b1aede-5c9d-427d-a8ed-78b7a85775aa tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:26.102076 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-c8b1aede-5c9d-427d-a8ed-78b7a85775aa tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023a04369b394bd1b035ab793e0b93b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf0858834c84aaa993de55f361d6ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:26.117365 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-c8b1aede-5c9d-427d-a8ed-78b7a85775aa tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] 10.222.0.20 "GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851" status: 200 len: 1273 microversion: 2.1 time: 0.297154 Aug 12 01:28:26.118247 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 19/36] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:25 2022] GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851 => generated 1273 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:26.691343 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-95f8e1ed-f37b-4f57-bb19-7ebc0bc9aa53 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:26.692580 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-95f8e1ed-f37b-4f57-bb19-7ebc0bc9aa53 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:26.707435 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-95f8e1ed-f37b-4f57-bb19-7ebc0bc9aa53 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:26.708125 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-95f8e1ed-f37b-4f57-bb19-7ebc0bc9aa53 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:26.708814 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-95f8e1ed-f37b-4f57-bb19-7ebc0bc9aa53 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:26.709720 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-95f8e1ed-f37b-4f57-bb19-7ebc0bc9aa53 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:26.710358 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-95f8e1ed-f37b-4f57-bb19-7ebc0bc9aa53 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:26.710981 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-95f8e1ed-f37b-4f57-bb19-7ebc0bc9aa53 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:26.904460 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-844e1d8e-3f0a-494f-a50e-b2ebe0abca67 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:26.905065 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-844e1d8e-3f0a-494f-a50e-b2ebe0abca67 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:26.915310 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-844e1d8e-3f0a-494f-a50e-b2ebe0abca67 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:26.926041 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-844e1d8e-3f0a-494f-a50e-b2ebe0abca67 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:26.926489 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-844e1d8e-3f0a-494f-a50e-b2ebe0abca67 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:26.927266 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-844e1d8e-3f0a-494f-a50e-b2ebe0abca67 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:26.927757 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-844e1d8e-3f0a-494f-a50e-b2ebe0abca67 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:26.928179 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-844e1d8e-3f0a-494f-a50e-b2ebe0abca67 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:27.394782 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-95f8e1ed-f37b-4f57-bb19-7ebc0bc9aa53 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:27.417145 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-95f8e1ed-f37b-4f57-bb19-7ebc0bc9aa53 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1280 microversion: 2.1 time: 0.730427 Aug 12 01:28:27.418234 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 18/37] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:26 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1280 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:27.423019 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-b75c18be-7ad1-40d4-bcb2-805957f120a6 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:27.424035 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-b75c18be-7ad1-40d4-bcb2-805957f120a6 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] [instance: 26be209b-84c3-49e2-a869-ea8c00f94851] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:27.440451 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b75c18be-7ad1-40d4-bcb2-805957f120a6 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:27.441172 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b75c18be-7ad1-40d4-bcb2-805957f120a6 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:27.441773 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b75c18be-7ad1-40d4-bcb2-805957f120a6 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:27.443142 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b75c18be-7ad1-40d4-bcb2-805957f120a6 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:27.443786 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b75c18be-7ad1-40d4-bcb2-805957f120a6 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:27.444372 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b75c18be-7ad1-40d4-bcb2-805957f120a6 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:27.471924 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-844e1d8e-3f0a-494f-a50e-b2ebe0abca67 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:27.481242 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-844e1d8e-3f0a-494f-a50e-b2ebe0abca67 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1240 microversion: 2.1 time: 0.580626 Aug 12 01:28:27.482450 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 20/38] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:26 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1240 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:28:27.497281 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-ee9e6666-24c6-46a5-8454-65a04987b07c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2105172684", "imageRef": "0d77ae04-91a5-4e2b-8817-72986618c549", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c69785c6-9bf5-4740-9585-57c14141c241"}], "security_groups": [{"name": "tempest-securitygroup--1612844143"}], "key_name": "tempest-keypair-903954503", "user_data": "}} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:28:27.923998 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.network.neutron [None req-ee9e6666-24c6-46a5-8454-65a04987b07c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] validate_networks() for [('c69785c6-9bf5-4740-9585-57c14141c241', None, None, None, None, None)] {{(pid=120786) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 01:28:28.090962 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-b75c18be-7ad1-40d4-bcb2-805957f120a6 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023a04369b394bd1b035ab793e0b93b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf0858834c84aaa993de55f361d6ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:28.099503 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-b75c18be-7ad1-40d4-bcb2-805957f120a6 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] 10.222.0.20 "GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851" status: 200 len: 1315 microversion: 2.1 time: 0.679811 Aug 12 01:28:28.103029 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 19/39] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:27 2022] GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851 => generated 1315 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:28.363444 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-40d4ec52-3393-4731-98d1-669288dcf152 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-663274443", "imageRef": "0d77ae04-91a5-4e2b-8817-72986618c549", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bdc64372-39dc-45f5-ae9b-e7b46a872a57"}], "security_groups": [{"name": "tempest-securitygroup--1066025119"}], "key_name": "tempest-keypair-1819394950", "user_data": "}} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:28:28.655341 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.network.neutron [None req-40d4ec52-3393-4731-98d1-669288dcf152 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] validate_networks() for [('bdc64372-39dc-45f5-ae9b-e7b46a872a57', None, None, None, None, None)] {{(pid=120785) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 01:28:28.832291 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-ee9e6666-24c6-46a5-8454-65a04987b07c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Flavor limits 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 01:28:28.833004 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-ee9e6666-24c6-46a5-8454-65a04987b07c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Image limits 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 01:28:28.833808 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-ee9e6666-24c6-46a5-8454-65a04987b07c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Flavor pref 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 01:28:28.834353 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-ee9e6666-24c6-46a5-8454-65a04987b07c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Image pref 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 01:28:28.835041 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-ee9e6666-24c6-46a5-8454-65a04987b07c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 01:28:28.871604 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ee9e6666-24c6-46a5-8454-65a04987b07c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:28.873335 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ee9e6666-24c6-46a5-8454-65a04987b07c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:28.875020 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ee9e6666-24c6-46a5-8454-65a04987b07c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:28.879015 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ee9e6666-24c6-46a5-8454-65a04987b07c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:28.880165 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ee9e6666-24c6-46a5-8454-65a04987b07c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:28.882216 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ee9e6666-24c6-46a5-8454-65a04987b07c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:28.950110 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.quota [None req-ee9e6666-24c6-46a5-8454-65a04987b07c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Getting quotas for project e5e2fd72103c4b5e956ef5b9c291f16d. Resources: {'cores', 'ram', 'instances'} {{(pid=120786) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 01:28:28.962913 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.quota [None req-ee9e6666-24c6-46a5-8454-65a04987b07c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Getting quotas for user 4395876e1de944ae82d23d43a30a82a8 and project e5e2fd72103c4b5e956ef5b9c291f16d. Resources: {'cores', 'ram', 'instances'} {{(pid=120786) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 01:28:29.015027 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-ee9e6666-24c6-46a5-8454-65a04987b07c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Going to run 1 instances... {{(pid=120786) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 01:28:29.024013 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-ee9e6666-24c6-46a5-8454-65a04987b07c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d77ae04-91a5-4e2b-8817-72986618c549',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120786) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 01:28:29.147955 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-ee9e6666-24c6-46a5-8454-65a04987b07c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.664253 Aug 12 01:28:29.168196 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 01:28:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 1685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 01:28:29.175809 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-4bed860a-b9c4-4928-be41-42621171b24a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:29.176652 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-4bed860a-b9c4-4928-be41-42621171b24a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:29.184111 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4bed860a-b9c4-4928-be41-42621171b24a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:29.212004 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4bed860a-b9c4-4928-be41-42621171b24a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:29.214575 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4bed860a-b9c4-4928-be41-42621171b24a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:29.218511 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4bed860a-b9c4-4928-be41-42621171b24a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:29.219578 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4bed860a-b9c4-4928-be41-42621171b24a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:29.222037 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4bed860a-b9c4-4928-be41-42621171b24a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:30.045890 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-4bed860a-b9c4-4928-be41-42621171b24a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:30.068511 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-4bed860a-b9c4-4928-be41-42621171b24a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1322 microversion: 2.1 time: 0.896848 Aug 12 01:28:30.069453 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 22/41] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:29 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1322 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:30.091747 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-dda2b379-fcd7-4470-a2a1-cb356a3fa16b tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:30.094256 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-dda2b379-fcd7-4470-a2a1-cb356a3fa16b tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:30.112037 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dda2b379-fcd7-4470-a2a1-cb356a3fa16b tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:30.112673 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dda2b379-fcd7-4470-a2a1-cb356a3fa16b tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:30.116194 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dda2b379-fcd7-4470-a2a1-cb356a3fa16b tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:30.116961 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dda2b379-fcd7-4470-a2a1-cb356a3fa16b tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:30.117443 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dda2b379-fcd7-4470-a2a1-cb356a3fa16b tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:30.120475 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dda2b379-fcd7-4470-a2a1-cb356a3fa16b tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:30.511463 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-40d4ec52-3393-4731-98d1-669288dcf152 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Flavor limits 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 01:28:30.512156 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-40d4ec52-3393-4731-98d1-669288dcf152 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Image limits 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 01:28:30.512543 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-40d4ec52-3393-4731-98d1-669288dcf152 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Flavor pref 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 01:28:30.513099 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-40d4ec52-3393-4731-98d1-669288dcf152 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Image pref 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 01:28:30.513593 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-40d4ec52-3393-4731-98d1-669288dcf152 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 01:28:30.536077 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-40d4ec52-3393-4731-98d1-669288dcf152 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:30.539822 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-40d4ec52-3393-4731-98d1-669288dcf152 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:30.540341 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-40d4ec52-3393-4731-98d1-669288dcf152 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:30.543455 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-40d4ec52-3393-4731-98d1-669288dcf152 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:30.543967 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-40d4ec52-3393-4731-98d1-669288dcf152 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:30.544403 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-40d4ec52-3393-4731-98d1-669288dcf152 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:30.585072 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-dda2b379-fcd7-4470-a2a1-cb356a3fa16b tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:30.606367 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-dda2b379-fcd7-4470-a2a1-cb356a3fa16b tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1288 microversion: 2.1 time: 0.530379 Aug 12 01:28:30.616456 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 23/42] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:30 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1288 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:30.626752 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.quota [None req-40d4ec52-3393-4731-98d1-669288dcf152 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Getting quotas for project 9d33b640693442238516535af8320529. Resources: {'cores', 'ram', 'instances'} {{(pid=120785) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 01:28:30.632926 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.quota [None req-40d4ec52-3393-4731-98d1-669288dcf152 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Getting quotas for user be3709a7f73442e79e7d5ad0c9389ac1 and project 9d33b640693442238516535af8320529. Resources: {'cores', 'ram', 'instances'} {{(pid=120785) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 01:28:30.665258 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-40d4ec52-3393-4731-98d1-669288dcf152 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Going to run 1 instances... {{(pid=120785) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 01:28:30.667608 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-40d4ec52-3393-4731-98d1-669288dcf152 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d77ae04-91a5-4e2b-8817-72986618c549',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120785) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 01:28:30.797148 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-40d4ec52-3393-4731-98d1-669288dcf152 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.438633 Aug 12 01:28:30.797808 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 20/43] 10.222.0.20 () {62 vars in 1188 bytes} [Fri Aug 12 01:28:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 2441 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 12 01:28:30.820017 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-d4331224-4f61-4bc4-b112-02ceb876a670 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:30.823079 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-d4331224-4f61-4bc4-b112-02ceb876a670 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] [instance: 26be209b-84c3-49e2-a869-ea8c00f94851] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:30.844435 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d4331224-4f61-4bc4-b112-02ceb876a670 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:30.847278 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d4331224-4f61-4bc4-b112-02ceb876a670 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:30.850945 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d4331224-4f61-4bc4-b112-02ceb876a670 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:30.856462 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d4331224-4f61-4bc4-b112-02ceb876a670 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:30.857021 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d4331224-4f61-4bc4-b112-02ceb876a670 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:30.858522 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d4331224-4f61-4bc4-b112-02ceb876a670 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:31.338678 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-cfba35f4-c4ee-47e2-80a2-9c1f43fab3cc req-193b7f8e-a989-4849-8b1a-73da45449799 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e1a8df3-8078-437c-ab98-64d52e277263", "tag": "f387b69c-4056-4801-b83e-52cf09447e9f"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:28:31.389885 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-cfba35f4-c4ee-47e2-80a2-9c1f43fab3cc req-193b7f8e-a989-4849-8b1a-73da45449799 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:31.400198 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-cfba35f4-c4ee-47e2-80a2-9c1f43fab3cc req-193b7f8e-a989-4849-8b1a-73da45449799 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:31.401912 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-cfba35f4-c4ee-47e2-80a2-9c1f43fab3cc req-193b7f8e-a989-4849-8b1a-73da45449799 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:31.470805 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-cfba35f4-c4ee-47e2-80a2-9c1f43fab3cc req-193b7f8e-a989-4849-8b1a-73da45449799 service nova] Creating event network-changed:f387b69c-4056-4801-b83e-52cf09447e9f for instance 1e1a8df3-8078-437c-ab98-64d52e277263 on hv-cinder-78481 Aug 12 01:28:31.471334 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-cfba35f4-c4ee-47e2-80a2-9c1f43fab3cc req-193b7f8e-a989-4849-8b1a-73da45449799 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120786) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 12 01:28:31.471758 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-cfba35f4-c4ee-47e2-80a2-9c1f43fab3cc req-193b7f8e-a989-4849-8b1a-73da45449799 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120786) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 12 01:28:31.472840 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e7d0ff9c-3491-4d73-8144-c4eb08877355 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:31.474654 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e7d0ff9c-3491-4d73-8144-c4eb08877355 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:31.475246 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e7d0ff9c-3491-4d73-8144-c4eb08877355 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:31.476271 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e7d0ff9c-3491-4d73-8144-c4eb08877355 None None] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:31.476867 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e7d0ff9c-3491-4d73-8144-c4eb08877355 None None] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:31.477415 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e7d0ff9c-3491-4d73-8144-c4eb08877355 None None] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:31.488513 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.compute.rpcapi [None req-e7d0ff9c-3491-4d73-8144-c4eb08877355 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 12 01:28:31.489855 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e7d0ff9c-3491-4d73-8144-c4eb08877355 None None] Releasing lock "compute-rpcapi-router" {{(pid=120786) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 12 01:28:31.523279 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-e7d0ff9c-3491-4d73-8144-c4eb08877355 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.914541 Aug 12 01:28:31.524898 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 24/44] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:28:31.539329 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-0b62a374-2aaf-4353-afbb-53b399daad7b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:31.546002 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-0b62a374-2aaf-4353-afbb-53b399daad7b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:31.549544 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:28:31.562216 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0b62a374-2aaf-4353-afbb-53b399daad7b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:31.564521 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0b62a374-2aaf-4353-afbb-53b399daad7b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:31.572289 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0b62a374-2aaf-4353-afbb-53b399daad7b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:31.573276 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0b62a374-2aaf-4353-afbb-53b399daad7b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:31.592549 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0b62a374-2aaf-4353-afbb-53b399daad7b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:31.593191 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0b62a374-2aaf-4353-afbb-53b399daad7b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:31.721090 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-d4331224-4f61-4bc4-b112-02ceb876a670 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023a04369b394bd1b035ab793e0b93b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf0858834c84aaa993de55f361d6ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:31.732786 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-d4331224-4f61-4bc4-b112-02ceb876a670 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] 10.222.0.20 "GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851" status: 200 len: 1315 microversion: 2.1 time: 0.922578 Aug 12 01:28:31.739820 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 21/45] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:30 2022] GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851 => generated 1315 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:31.774208 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-360899cd-2d9a-4b5b-95e4-ef68b33a1ad0 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:31.776054 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-360899cd-2d9a-4b5b-95e4-ef68b33a1ad0 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:31.845113 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-0b62a374-2aaf-4353-afbb-53b399daad7b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:31.857558 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-0b62a374-2aaf-4353-afbb-53b399daad7b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9" status: 200 len: 1293 microversion: 2.1 time: 0.331332 Aug 12 01:28:31.862729 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 25/46] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:31 2022] GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 => generated 1293 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:31.881726 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-dd507a2b-fe25-4ffe-9a71-6ef4fea85e42 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:31.882628 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-dd507a2b-fe25-4ffe-9a71-6ef4fea85e42 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:31.894413 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-360899cd-2d9a-4b5b-95e4-ef68b33a1ad0 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:31.904288 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-360899cd-2d9a-4b5b-95e4-ef68b33a1ad0 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:31.908600 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-360899cd-2d9a-4b5b-95e4-ef68b33a1ad0 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:31.914076 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-360899cd-2d9a-4b5b-95e4-ef68b33a1ad0 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1281 microversion: 2.20 time: 0.172678 Aug 12 01:28:31.916016 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 22/47] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:28:31 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1281 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:28:31.921084 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-ba15cc66-bce8-475a-a70a-b2f1164d520d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:31.928267 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dd507a2b-fe25-4ffe-9a71-6ef4fea85e42 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:31.929347 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-ba15cc66-bce8-475a-a70a-b2f1164d520d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:31.934877 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dd507a2b-fe25-4ffe-9a71-6ef4fea85e42 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:31.936488 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dd507a2b-fe25-4ffe-9a71-6ef4fea85e42 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:31.938936 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dd507a2b-fe25-4ffe-9a71-6ef4fea85e42 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:31.945850 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dd507a2b-fe25-4ffe-9a71-6ef4fea85e42 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:31.946777 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dd507a2b-fe25-4ffe-9a71-6ef4fea85e42 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:31.953832 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ba15cc66-bce8-475a-a70a-b2f1164d520d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:31.962543 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ba15cc66-bce8-475a-a70a-b2f1164d520d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:31.963231 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ba15cc66-bce8-475a-a70a-b2f1164d520d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:31.967056 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ba15cc66-bce8-475a-a70a-b2f1164d520d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:31.967787 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ba15cc66-bce8-475a-a70a-b2f1164d520d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:31.972226 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ba15cc66-bce8-475a-a70a-b2f1164d520d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:32.448152 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-ba15cc66-bce8-475a-a70a-b2f1164d520d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:32.456017 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-ba15cc66-bce8-475a-a70a-b2f1164d520d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1294 microversion: 2.1 time: 0.538536 Aug 12 01:28:32.459900 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 23/48] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:31 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1294 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:32.575699 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-dd507a2b-fe25-4ffe-9a71-6ef4fea85e42 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:32.586699 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-dd507a2b-fe25-4ffe-9a71-6ef4fea85e42 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1322 microversion: 2.1 time: 0.719173 Aug 12 01:28:32.597006 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 26/49] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:31 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1322 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:32.766816 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-be5dc722-20d6-45a2-bd6e-f12a41d4df2d tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:32.768771 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-be5dc722-20d6-45a2-bd6e-f12a41d4df2d tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] [instance: 26be209b-84c3-49e2-a869-ea8c00f94851] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:32.782094 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-be5dc722-20d6-45a2-bd6e-f12a41d4df2d tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:32.784267 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-be5dc722-20d6-45a2-bd6e-f12a41d4df2d tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:32.784922 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-be5dc722-20d6-45a2-bd6e-f12a41d4df2d tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:32.794495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-be5dc722-20d6-45a2-bd6e-f12a41d4df2d tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:32.795206 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-be5dc722-20d6-45a2-bd6e-f12a41d4df2d tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:32.795880 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-be5dc722-20d6-45a2-bd6e-f12a41d4df2d tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:32.879338 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-594101bf-a7b2-4eee-8dbc-c586b2bd0784 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:32.881018 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-594101bf-a7b2-4eee-8dbc-c586b2bd0784 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:32.896979 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-594101bf-a7b2-4eee-8dbc-c586b2bd0784 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:32.898871 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-594101bf-a7b2-4eee-8dbc-c586b2bd0784 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:32.900175 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-594101bf-a7b2-4eee-8dbc-c586b2bd0784 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:32.905397 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-594101bf-a7b2-4eee-8dbc-c586b2bd0784 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:32.908253 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-594101bf-a7b2-4eee-8dbc-c586b2bd0784 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:32.909038 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-594101bf-a7b2-4eee-8dbc-c586b2bd0784 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:33.160898 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-594101bf-a7b2-4eee-8dbc-c586b2bd0784 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:33.169260 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-594101bf-a7b2-4eee-8dbc-c586b2bd0784 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9" status: 200 len: 1299 microversion: 2.1 time: 0.294656 Aug 12 01:28:33.171829 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 27/50] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:32 2022] GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 => generated 1299 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:33.182832 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-80a2de14-120c-4381-b164-d9c2ac99807b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:33.188199 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-80a2de14-120c-4381-b164-d9c2ac99807b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:33.205847 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-80a2de14-120c-4381-b164-d9c2ac99807b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:33.211202 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-80a2de14-120c-4381-b164-d9c2ac99807b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:33.212091 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-80a2de14-120c-4381-b164-d9c2ac99807b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:33.213185 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-80a2de14-120c-4381-b164-d9c2ac99807b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:33.213880 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-80a2de14-120c-4381-b164-d9c2ac99807b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:33.214446 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-80a2de14-120c-4381-b164-d9c2ac99807b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:34.261387 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-be5dc722-20d6-45a2-bd6e-f12a41d4df2d tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023a04369b394bd1b035ab793e0b93b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf0858834c84aaa993de55f361d6ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:34.261999 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-80a2de14-120c-4381-b164-d9c2ac99807b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:34.272802 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-80a2de14-120c-4381-b164-d9c2ac99807b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:34.277595 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-80a2de14-120c-4381-b164-d9c2ac99807b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:34.279405 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-be5dc722-20d6-45a2-bd6e-f12a41d4df2d tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] 10.222.0.20 "GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851" status: 200 len: 1315 microversion: 2.1 time: 1.516749 Aug 12 01:28:34.284336 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-80a2de14-120c-4381-b164-d9c2ac99807b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1333 microversion: 2.20 time: 1.111082 Aug 12 01:28:34.286258 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 28/51] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:28:33 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1333 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:28:34.291851 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 24/52] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:32 2022] GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851 => generated 1315 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:34.293449 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-98e7e304-cc6a-45e0-82bf-823bd792ba96 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:34.294260 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-98e7e304-cc6a-45e0-82bf-823bd792ba96 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:34.301487 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-98e7e304-cc6a-45e0-82bf-823bd792ba96 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:34.302910 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-98e7e304-cc6a-45e0-82bf-823bd792ba96 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:34.303726 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-98e7e304-cc6a-45e0-82bf-823bd792ba96 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:34.304796 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-98e7e304-cc6a-45e0-82bf-823bd792ba96 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:34.307337 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-98e7e304-cc6a-45e0-82bf-823bd792ba96 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:34.308573 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-98e7e304-cc6a-45e0-82bf-823bd792ba96 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:34.311993 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-bf2f57db-d542-44fc-ab87-62cf245f1e17 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:34.312597 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-bf2f57db-d542-44fc-ab87-62cf245f1e17 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:34.325448 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bf2f57db-d542-44fc-ab87-62cf245f1e17 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:34.326141 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bf2f57db-d542-44fc-ab87-62cf245f1e17 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:34.327187 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bf2f57db-d542-44fc-ab87-62cf245f1e17 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:34.328259 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bf2f57db-d542-44fc-ab87-62cf245f1e17 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:34.329029 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bf2f57db-d542-44fc-ab87-62cf245f1e17 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:34.329659 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bf2f57db-d542-44fc-ab87-62cf245f1e17 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:35.281308 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-98e7e304-cc6a-45e0-82bf-823bd792ba96 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:35.300763 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-98e7e304-cc6a-45e0-82bf-823bd792ba96 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1294 microversion: 2.1 time: 1.011907 Aug 12 01:28:35.302637 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 29/53] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:34 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1294 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:35.324662 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-093676fe-4a36-47d0-a9e9-46084008ba7f req-b8812bbe-c398-4625-afb3-4d49ae908625 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2961f2a6-2c42-46af-8a74-98a8692ef170", "tag": "62bb6f5f-1dc9-4675-9d96-12163b24d167"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:28:35.380608 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-093676fe-4a36-47d0-a9e9-46084008ba7f req-b8812bbe-c398-4625-afb3-4d49ae908625 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:35.387213 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-093676fe-4a36-47d0-a9e9-46084008ba7f req-b8812bbe-c398-4625-afb3-4d49ae908625 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:35.388073 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-093676fe-4a36-47d0-a9e9-46084008ba7f req-b8812bbe-c398-4625-afb3-4d49ae908625 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:35.445844 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-093676fe-4a36-47d0-a9e9-46084008ba7f req-b8812bbe-c398-4625-afb3-4d49ae908625 service nova] Creating event network-changed:62bb6f5f-1dc9-4675-9d96-12163b24d167 for instance 2961f2a6-2c42-46af-8a74-98a8692ef170 on hv-cinder-78481 Aug 12 01:28:35.459263 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-093676fe-4a36-47d0-a9e9-46084008ba7f req-b8812bbe-c398-4625-afb3-4d49ae908625 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153933 Aug 12 01:28:35.461111 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 30/54] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:28:35.477088 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-6101311b-5eea-46c9-a76d-dbc370c8ac50 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:35.478806 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-6101311b-5eea-46c9-a76d-dbc370c8ac50 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:35.498879 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6101311b-5eea-46c9-a76d-dbc370c8ac50 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:35.500027 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6101311b-5eea-46c9-a76d-dbc370c8ac50 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:35.500999 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6101311b-5eea-46c9-a76d-dbc370c8ac50 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:35.502250 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6101311b-5eea-46c9-a76d-dbc370c8ac50 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:35.505307 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6101311b-5eea-46c9-a76d-dbc370c8ac50 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:35.506284 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6101311b-5eea-46c9-a76d-dbc370c8ac50 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:35.951474 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-bf2f57db-d542-44fc-ab87-62cf245f1e17 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:35.960437 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-bf2f57db-d542-44fc-ab87-62cf245f1e17 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1322 microversion: 2.1 time: 1.666921 Aug 12 01:28:35.972215 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 25/55] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:34 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1322 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:36.222179 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-6b696014-dbc2-4084-93e1-e764cf9052d0 req-95f959be-e924-4984-b157-23383bbd75e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26be209b-84c3-49e2-a869-ea8c00f94851", "tag": "e88a4d4f-78ca-43d6-9412-606c68ca8ff1"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:28:36.249915 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-6b696014-dbc2-4084-93e1-e764cf9052d0 req-95f959be-e924-4984-b157-23383bbd75e9 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:36.251321 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-6b696014-dbc2-4084-93e1-e764cf9052d0 req-95f959be-e924-4984-b157-23383bbd75e9 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:36.252437 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-6b696014-dbc2-4084-93e1-e764cf9052d0 req-95f959be-e924-4984-b157-23383bbd75e9 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:36.292355 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-6b696014-dbc2-4084-93e1-e764cf9052d0 req-95f959be-e924-4984-b157-23383bbd75e9 service nova] Creating event network-changed:e88a4d4f-78ca-43d6-9412-606c68ca8ff1 for instance 26be209b-84c3-49e2-a869-ea8c00f94851 on hv-cinder-78481 Aug 12 01:28:36.292989 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-6b696014-dbc2-4084-93e1-e764cf9052d0 req-95f959be-e924-4984-b157-23383bbd75e9 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120785) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 12 01:28:36.293418 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-6b696014-dbc2-4084-93e1-e764cf9052d0 req-95f959be-e924-4984-b157-23383bbd75e9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120785) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 12 01:28:36.297795 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8135f91b-f77e-4d0a-9b30-47e02195df14 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:36.297795 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8135f91b-f77e-4d0a-9b30-47e02195df14 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:36.297795 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8135f91b-f77e-4d0a-9b30-47e02195df14 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:36.297795 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8135f91b-f77e-4d0a-9b30-47e02195df14 None None] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:36.297795 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8135f91b-f77e-4d0a-9b30-47e02195df14 None None] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:36.298106 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8135f91b-f77e-4d0a-9b30-47e02195df14 None None] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:36.365265 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.compute.rpcapi [None req-8135f91b-f77e-4d0a-9b30-47e02195df14 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 12 01:28:36.368825 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8135f91b-f77e-4d0a-9b30-47e02195df14 None None] Releasing lock "compute-rpcapi-router" {{(pid=120785) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 12 01:28:36.400171 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-8135f91b-f77e-4d0a-9b30-47e02195df14 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.432804 Aug 12 01:28:36.401587 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 26/56] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:28:36.415001 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-91b9ee0d-3725-4edd-ac6d-e71e4c3509c4 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:36.415793 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-91b9ee0d-3725-4edd-ac6d-e71e4c3509c4 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] [instance: 26be209b-84c3-49e2-a869-ea8c00f94851] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:36.429094 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:28:36.433775 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-91b9ee0d-3725-4edd-ac6d-e71e4c3509c4 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:36.437119 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-91b9ee0d-3725-4edd-ac6d-e71e4c3509c4 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:36.439871 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-91b9ee0d-3725-4edd-ac6d-e71e4c3509c4 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:36.440865 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-91b9ee0d-3725-4edd-ac6d-e71e4c3509c4 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:36.442284 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-91b9ee0d-3725-4edd-ac6d-e71e4c3509c4 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:36.445209 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-91b9ee0d-3725-4edd-ac6d-e71e4c3509c4 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:36.696728 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-6101311b-5eea-46c9-a76d-dbc370c8ac50 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:36.706465 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-6101311b-5eea-46c9-a76d-dbc370c8ac50 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9" status: 200 len: 1367 microversion: 2.1 time: 1.241828 Aug 12 01:28:36.707063 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 31/57] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:35 2022] GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 => generated 1367 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:36.718149 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-ce978574-7417-4782-906a-50e95cf428dd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:36.718830 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-ce978574-7417-4782-906a-50e95cf428dd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:36.737590 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ce978574-7417-4782-906a-50e95cf428dd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:36.742071 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ce978574-7417-4782-906a-50e95cf428dd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:36.759113 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ce978574-7417-4782-906a-50e95cf428dd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:36.764331 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ce978574-7417-4782-906a-50e95cf428dd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:36.767055 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ce978574-7417-4782-906a-50e95cf428dd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:36.771893 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ce978574-7417-4782-906a-50e95cf428dd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:37.227809 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-ce978574-7417-4782-906a-50e95cf428dd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:37.238387 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-ce978574-7417-4782-906a-50e95cf428dd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:37.240909 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-ce978574-7417-4782-906a-50e95cf428dd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:37.243403 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-ce978574-7417-4782-906a-50e95cf428dd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1339 microversion: 2.20 time: 0.531760 Aug 12 01:28:37.258539 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 32/58] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:28:36 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1339 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:28:37.263697 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-7d29afad-1e5f-48ad-8b3a-6f9ac539c291 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:37.264519 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-7d29afad-1e5f-48ad-8b3a-6f9ac539c291 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:37.272278 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7d29afad-1e5f-48ad-8b3a-6f9ac539c291 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:37.272743 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7d29afad-1e5f-48ad-8b3a-6f9ac539c291 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:37.273326 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7d29afad-1e5f-48ad-8b3a-6f9ac539c291 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:37.274232 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7d29afad-1e5f-48ad-8b3a-6f9ac539c291 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:37.274887 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7d29afad-1e5f-48ad-8b3a-6f9ac539c291 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:37.275314 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7d29afad-1e5f-48ad-8b3a-6f9ac539c291 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:37.294505 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell1:SELECT=100 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:28:37.474438 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-91b9ee0d-3725-4edd-ac6d-e71e4c3509c4 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023a04369b394bd1b035ab793e0b93b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf0858834c84aaa993de55f361d6ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:37.481933 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-91b9ee0d-3725-4edd-ac6d-e71e4c3509c4 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] 10.222.0.20 "GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851" status: 200 len: 1315 microversion: 2.1 time: 1.078851 Aug 12 01:28:37.488924 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 27/59] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:36 2022] GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851 => generated 1315 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:37.503881 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-aef95c1b-f4a8-4526-9752-e3f386f28815 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:37.504713 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-aef95c1b-f4a8-4526-9752-e3f386f28815 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:37.511559 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-aef95c1b-f4a8-4526-9752-e3f386f28815 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:37.513379 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-aef95c1b-f4a8-4526-9752-e3f386f28815 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:37.515516 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-aef95c1b-f4a8-4526-9752-e3f386f28815 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:37.516482 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-aef95c1b-f4a8-4526-9752-e3f386f28815 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:37.518118 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-aef95c1b-f4a8-4526-9752-e3f386f28815 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:37.519300 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-aef95c1b-f4a8-4526-9752-e3f386f28815 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:37.673200 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-7d29afad-1e5f-48ad-8b3a-6f9ac539c291 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:37.687277 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-7d29afad-1e5f-48ad-8b3a-6f9ac539c291 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1362 microversion: 2.1 time: 0.427031 Aug 12 01:28:37.688364 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 33/60] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:37 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1362 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:37.730248 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-4e8220ee-1739-47d6-a177-1424ac712c5d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:37.731659 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-4e8220ee-1739-47d6-a177-1424ac712c5d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:37.737854 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4e8220ee-1739-47d6-a177-1424ac712c5d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:37.738557 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4e8220ee-1739-47d6-a177-1424ac712c5d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:37.739140 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4e8220ee-1739-47d6-a177-1424ac712c5d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:37.740063 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4e8220ee-1739-47d6-a177-1424ac712c5d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:37.740669 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4e8220ee-1739-47d6-a177-1424ac712c5d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:37.741225 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4e8220ee-1739-47d6-a177-1424ac712c5d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:37.974909 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-aef95c1b-f4a8-4526-9752-e3f386f28815 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:37.991885 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-aef95c1b-f4a8-4526-9752-e3f386f28815 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1322 microversion: 2.1 time: 0.500837 Aug 12 01:28:37.992493 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 28/61] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:37 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1322 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:38.080923 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-4e8220ee-1739-47d6-a177-1424ac712c5d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:38.090419 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-4e8220ee-1739-47d6-a177-1424ac712c5d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9" status: 200 len: 1367 microversion: 2.1 time: 0.362841 Aug 12 01:28:38.091630 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 34/62] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:37 2022] GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 => generated 1367 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:28:38.265630 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-07391023-2e0b-4fa5-a39d-20efd677b9a8 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:38.266645 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-07391023-2e0b-4fa5-a39d-20efd677b9a8 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:38.274200 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-07391023-2e0b-4fa5-a39d-20efd677b9a8 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:38.274820 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-07391023-2e0b-4fa5-a39d-20efd677b9a8 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:38.275559 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-07391023-2e0b-4fa5-a39d-20efd677b9a8 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:38.276626 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-07391023-2e0b-4fa5-a39d-20efd677b9a8 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:38.277230 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-07391023-2e0b-4fa5-a39d-20efd677b9a8 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:38.277777 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-07391023-2e0b-4fa5-a39d-20efd677b9a8 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:38.470904 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-07391023-2e0b-4fa5-a39d-20efd677b9a8 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:38.482137 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-07391023-2e0b-4fa5-a39d-20efd677b9a8 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:38.490493 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-07391023-2e0b-4fa5-a39d-20efd677b9a8 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:38.499420 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-89a265bd-f660-4607-ae3d-4f118c5ce587 req-2f32f6d8-6fba-41a7-b24e-7d700519dc34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da106e4a-1bc6-4e68-ac0c-1a2ca899daa9", "tag": "941dd4d7-4c16-4fb4-aa93-79972bef7581"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:28:38.508695 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-07391023-2e0b-4fa5-a39d-20efd677b9a8 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1407 microversion: 2.20 time: 0.245313 Aug 12 01:28:38.511016 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 29/63] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:28:38 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1407 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:28:38.525966 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-89a265bd-f660-4607-ae3d-4f118c5ce587 req-2f32f6d8-6fba-41a7-b24e-7d700519dc34 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:38.526858 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-89a265bd-f660-4607-ae3d-4f118c5ce587 req-2f32f6d8-6fba-41a7-b24e-7d700519dc34 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:38.527120 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-c285764c-3a36-4f3f-b32c-8fac91e52aa0 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:38.527686 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-89a265bd-f660-4607-ae3d-4f118c5ce587 req-2f32f6d8-6fba-41a7-b24e-7d700519dc34 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:38.527993 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-c285764c-3a36-4f3f-b32c-8fac91e52aa0 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] [instance: 26be209b-84c3-49e2-a869-ea8c00f94851] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:38.535176 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c285764c-3a36-4f3f-b32c-8fac91e52aa0 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:38.536086 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c285764c-3a36-4f3f-b32c-8fac91e52aa0 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:38.536847 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c285764c-3a36-4f3f-b32c-8fac91e52aa0 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:38.537748 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c285764c-3a36-4f3f-b32c-8fac91e52aa0 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:38.538367 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c285764c-3a36-4f3f-b32c-8fac91e52aa0 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:38.538916 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c285764c-3a36-4f3f-b32c-8fac91e52aa0 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:38.550053 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-89a265bd-f660-4607-ae3d-4f118c5ce587 req-2f32f6d8-6fba-41a7-b24e-7d700519dc34 service nova] Creating event network-changed:941dd4d7-4c16-4fb4-aa93-79972bef7581 for instance da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 on hv-cinder-78481 Aug 12 01:28:38.559506 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-89a265bd-f660-4607-ae3d-4f118c5ce587 req-2f32f6d8-6fba-41a7-b24e-7d700519dc34 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063141 Aug 12 01:28:38.560779 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 35/64] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:28:38.689206 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-c285764c-3a36-4f3f-b32c-8fac91e52aa0 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023a04369b394bd1b035ab793e0b93b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf0858834c84aaa993de55f361d6ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:38.699382 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-c285764c-3a36-4f3f-b32c-8fac91e52aa0 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] 10.222.0.20 "GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851" status: 200 len: 1315 microversion: 2.1 time: 0.186872 Aug 12 01:28:38.700213 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 30/65] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:38 2022] GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:38.720197 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-9afcc488-5c43-4f55-a53a-7d67d9c4fdbd tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:38.721475 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-9afcc488-5c43-4f55-a53a-7d67d9c4fdbd tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:38.730819 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9afcc488-5c43-4f55-a53a-7d67d9c4fdbd tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:38.731834 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9afcc488-5c43-4f55-a53a-7d67d9c4fdbd tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:38.732357 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9afcc488-5c43-4f55-a53a-7d67d9c4fdbd tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:38.733320 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9afcc488-5c43-4f55-a53a-7d67d9c4fdbd tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:38.733983 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9afcc488-5c43-4f55-a53a-7d67d9c4fdbd tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:38.734572 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9afcc488-5c43-4f55-a53a-7d67d9c4fdbd tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:38.909701 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-9afcc488-5c43-4f55-a53a-7d67d9c4fdbd tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:38.919353 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-9afcc488-5c43-4f55-a53a-7d67d9c4fdbd tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1362 microversion: 2.1 time: 0.210341 Aug 12 01:28:38.922050 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 36/66] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:38 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:39.012997 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-40ec6765-e8e9-4066-a312-074fc6e4275b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:39.013600 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-40ec6765-e8e9-4066-a312-074fc6e4275b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:39.023462 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-40ec6765-e8e9-4066-a312-074fc6e4275b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:39.024662 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-40ec6765-e8e9-4066-a312-074fc6e4275b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:39.025275 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-40ec6765-e8e9-4066-a312-074fc6e4275b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:39.026682 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-40ec6765-e8e9-4066-a312-074fc6e4275b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:39.027779 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-40ec6765-e8e9-4066-a312-074fc6e4275b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:39.028711 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-40ec6765-e8e9-4066-a312-074fc6e4275b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:39.121233 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-fbbdddf4-a9a9-473c-97d0-fd42a5b30f87 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:39.122190 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-fbbdddf4-a9a9-473c-97d0-fd42a5b30f87 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:39.125668 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell0:SELECT=30 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:28:39.132067 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fbbdddf4-a9a9-473c-97d0-fd42a5b30f87 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:39.133232 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fbbdddf4-a9a9-473c-97d0-fd42a5b30f87 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:39.134430 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fbbdddf4-a9a9-473c-97d0-fd42a5b30f87 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:39.135276 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fbbdddf4-a9a9-473c-97d0-fd42a5b30f87 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:39.135931 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fbbdddf4-a9a9-473c-97d0-fd42a5b30f87 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:39.136493 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fbbdddf4-a9a9-473c-97d0-fd42a5b30f87 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:39.447916 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-40ec6765-e8e9-4066-a312-074fc6e4275b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:39.459227 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-40ec6765-e8e9-4066-a312-074fc6e4275b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1322 microversion: 2.1 time: 0.450255 Aug 12 01:28:39.460006 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 31/67] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:39 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1322 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:39.520724 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-fbbdddf4-a9a9-473c-97d0-fd42a5b30f87 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:39.544303 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-1815a6af-4948-48ac-9ccb-d350a4a71976 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:39.550239 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-1815a6af-4948-48ac-9ccb-d350a4a71976 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:39.563034 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-fbbdddf4-a9a9-473c-97d0-fd42a5b30f87 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9" status: 200 len: 1367 microversion: 2.1 time: 0.449394 Aug 12 01:28:39.564351 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 37/68] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:39 2022] GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 => generated 1367 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:28:39.565677 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1815a6af-4948-48ac-9ccb-d350a4a71976 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:39.566167 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1815a6af-4948-48ac-9ccb-d350a4a71976 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:39.566595 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1815a6af-4948-48ac-9ccb-d350a4a71976 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:39.567372 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1815a6af-4948-48ac-9ccb-d350a4a71976 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:39.567897 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1815a6af-4948-48ac-9ccb-d350a4a71976 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:39.568949 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1815a6af-4948-48ac-9ccb-d350a4a71976 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:39.726294 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-fb3e69f8-7bd7-4c0e-9597-330d869786f5 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:39.730457 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-fb3e69f8-7bd7-4c0e-9597-330d869786f5 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] [instance: 26be209b-84c3-49e2-a869-ea8c00f94851] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:39.740877 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fb3e69f8-7bd7-4c0e-9597-330d869786f5 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:39.742612 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fb3e69f8-7bd7-4c0e-9597-330d869786f5 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:39.743048 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fb3e69f8-7bd7-4c0e-9597-330d869786f5 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:39.743794 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fb3e69f8-7bd7-4c0e-9597-330d869786f5 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:39.754621 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fb3e69f8-7bd7-4c0e-9597-330d869786f5 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:39.755339 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fb3e69f8-7bd7-4c0e-9597-330d869786f5 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:40.064389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-1815a6af-4948-48ac-9ccb-d350a4a71976 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:40.079737 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-1815a6af-4948-48ac-9ccb-d350a4a71976 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:40.083699 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-1815a6af-4948-48ac-9ccb-d350a4a71976 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:40.086876 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-1815a6af-4948-48ac-9ccb-d350a4a71976 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1407 microversion: 2.20 time: 0.558346 Aug 12 01:28:40.090486 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 32/69] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:28:39 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1407 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:28:40.103881 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-513ebfd6-908f-4010-a33e-bcd14e4acc9e tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:40.106990 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-513ebfd6-908f-4010-a33e-bcd14e4acc9e tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:40.121104 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-513ebfd6-908f-4010-a33e-bcd14e4acc9e tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:40.123421 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-513ebfd6-908f-4010-a33e-bcd14e4acc9e tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:40.124760 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-513ebfd6-908f-4010-a33e-bcd14e4acc9e tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:40.126832 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-513ebfd6-908f-4010-a33e-bcd14e4acc9e tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:40.128845 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-513ebfd6-908f-4010-a33e-bcd14e4acc9e tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:40.130594 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-513ebfd6-908f-4010-a33e-bcd14e4acc9e tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:40.554160 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-fb3e69f8-7bd7-4c0e-9597-330d869786f5 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023a04369b394bd1b035ab793e0b93b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf0858834c84aaa993de55f361d6ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:40.567378 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-fb3e69f8-7bd7-4c0e-9597-330d869786f5 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] 10.222.0.20 "GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851" status: 200 len: 1315 microversion: 2.1 time: 0.846663 Aug 12 01:28:40.568681 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 38/70] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:39 2022] GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851 => generated 1315 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:40.576046 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-67afe612-6e11-4147-a54f-608c0e681150 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:40.577525 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-67afe612-6e11-4147-a54f-608c0e681150 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:40.588633 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-67afe612-6e11-4147-a54f-608c0e681150 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:40.589396 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-67afe612-6e11-4147-a54f-608c0e681150 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:40.591713 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-67afe612-6e11-4147-a54f-608c0e681150 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:40.592898 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-67afe612-6e11-4147-a54f-608c0e681150 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:40.593550 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-67afe612-6e11-4147-a54f-608c0e681150 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:40.594304 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-67afe612-6e11-4147-a54f-608c0e681150 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:40.778527 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-513ebfd6-908f-4010-a33e-bcd14e4acc9e tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:40.796041 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-513ebfd6-908f-4010-a33e-bcd14e4acc9e tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1362 microversion: 2.1 time: 0.701859 Aug 12 01:28:40.809655 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 33/71] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:40 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1362 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:40.809655 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-b83536ae-cc3e-484f-806e-c4722a007d15 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:40.809655 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-b83536ae-cc3e-484f-806e-c4722a007d15 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:40.809655 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b83536ae-cc3e-484f-806e-c4722a007d15 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:40.810145 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b83536ae-cc3e-484f-806e-c4722a007d15 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:40.810145 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b83536ae-cc3e-484f-806e-c4722a007d15 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:40.810145 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b83536ae-cc3e-484f-806e-c4722a007d15 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:40.810145 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b83536ae-cc3e-484f-806e-c4722a007d15 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:40.810579 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b83536ae-cc3e-484f-806e-c4722a007d15 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:41.044253 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-67afe612-6e11-4147-a54f-608c0e681150 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:41.059463 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-67afe612-6e11-4147-a54f-608c0e681150 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1322 microversion: 2.1 time: 0.489381 Aug 12 01:28:41.061720 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 39/72] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:40 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1322 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:41.140240 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-b53a91c5-11e1-4b67-a07e-ea22557c8aa6 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:41.140863 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-b53a91c5-11e1-4b67-a07e-ea22557c8aa6 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:41.171465 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b53a91c5-11e1-4b67-a07e-ea22557c8aa6 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:41.172463 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b53a91c5-11e1-4b67-a07e-ea22557c8aa6 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:41.172912 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b53a91c5-11e1-4b67-a07e-ea22557c8aa6 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:41.173635 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b53a91c5-11e1-4b67-a07e-ea22557c8aa6 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:41.178177 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b53a91c5-11e1-4b67-a07e-ea22557c8aa6 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:41.178653 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b53a91c5-11e1-4b67-a07e-ea22557c8aa6 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:41.264726 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-b83536ae-cc3e-484f-806e-c4722a007d15 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:41.276210 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-b83536ae-cc3e-484f-806e-c4722a007d15 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9" status: 200 len: 1367 microversion: 2.1 time: 0.478334 Aug 12 01:28:41.277095 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 34/73] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:40 2022] GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 => generated 1367 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:41.487399 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell0:SELECT=8 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:28:41.626380 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-5b1cf187-41c7-47aa-9e95-068e7190d9f8 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:41.629239 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-5b1cf187-41c7-47aa-9e95-068e7190d9f8 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] [instance: 26be209b-84c3-49e2-a869-ea8c00f94851] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:41.654260 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5b1cf187-41c7-47aa-9e95-068e7190d9f8 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:41.654749 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5b1cf187-41c7-47aa-9e95-068e7190d9f8 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:41.655325 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5b1cf187-41c7-47aa-9e95-068e7190d9f8 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:41.664630 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5b1cf187-41c7-47aa-9e95-068e7190d9f8 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:41.664849 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5b1cf187-41c7-47aa-9e95-068e7190d9f8 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:41.665169 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5b1cf187-41c7-47aa-9e95-068e7190d9f8 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:41.750564 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-b53a91c5-11e1-4b67-a07e-ea22557c8aa6 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:41.765425 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-b53a91c5-11e1-4b67-a07e-ea22557c8aa6 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:41.767299 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-b53a91c5-11e1-4b67-a07e-ea22557c8aa6 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:41.776685 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-b53a91c5-11e1-4b67-a07e-ea22557c8aa6 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1407 microversion: 2.20 time: 0.667792 Aug 12 01:28:41.777519 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 40/74] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:28:41 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1407 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:28:41.900210 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell0:SELECT=32 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:28:41.939045 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-154d295d-5bef-467f-b290-697ac507a3c2 req-f04b8877-9049-4cb6-bda0-1c62bcb2d988 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e1a8df3-8078-437c-ab98-64d52e277263", "name": "network-vif-plugged", "status": "completed", "tag": "f387b69c-4056-4801-b83e-52cf09447e9f"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:28:41.965037 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-154d295d-5bef-467f-b290-697ac507a3c2 req-f04b8877-9049-4cb6-bda0-1c62bcb2d988 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:41.965512 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-154d295d-5bef-467f-b290-697ac507a3c2 req-f04b8877-9049-4cb6-bda0-1c62bcb2d988 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:41.965933 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-154d295d-5bef-467f-b290-697ac507a3c2 req-f04b8877-9049-4cb6-bda0-1c62bcb2d988 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:41.978508 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-154d295d-5bef-467f-b290-697ac507a3c2 req-f04b8877-9049-4cb6-bda0-1c62bcb2d988 service nova] Creating event network-vif-plugged:f387b69c-4056-4801-b83e-52cf09447e9f for instance 1e1a8df3-8078-437c-ab98-64d52e277263 on hv-cinder-78481 Aug 12 01:28:41.991919 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-154d295d-5bef-467f-b290-697ac507a3c2 req-f04b8877-9049-4cb6-bda0-1c62bcb2d988 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.212951 Aug 12 01:28:41.995819 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 41/75] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:28:42.009484 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-19716a77-d461-4147-b48b-01342a363071 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:42.010583 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-19716a77-d461-4147-b48b-01342a363071 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:42.018551 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-19716a77-d461-4147-b48b-01342a363071 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:42.019299 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-19716a77-d461-4147-b48b-01342a363071 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:42.019903 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-19716a77-d461-4147-b48b-01342a363071 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:42.021026 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-19716a77-d461-4147-b48b-01342a363071 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:42.021632 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-19716a77-d461-4147-b48b-01342a363071 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:42.022190 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-19716a77-d461-4147-b48b-01342a363071 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:42.395828 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-5b1cf187-41c7-47aa-9e95-068e7190d9f8 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023a04369b394bd1b035ab793e0b93b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf0858834c84aaa993de55f361d6ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:42.406988 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell1:SELECT=100 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:28:42.410642 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-5b1cf187-41c7-47aa-9e95-068e7190d9f8 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] 10.222.0.20 "GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851" status: 200 len: 1315 microversion: 2.1 time: 0.812387 Aug 12 01:28:42.411721 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 35/76] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:41 2022] GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851 => generated 1315 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:42.416885 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-ee8d8843-c93f-458c-a56c-d20cbde8f8fd req-9d2c271e-b36f-49cf-a7d7-e2bf0b606cdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ed5ced2-87ad-4d0f-860c-648bcca91ca8", "tag": "476d0433-5310-435b-93ea-c42ed83c3136"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:28:42.426671 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-ee8d8843-c93f-458c-a56c-d20cbde8f8fd req-9d2c271e-b36f-49cf-a7d7-e2bf0b606cdc service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:42.427332 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-ee8d8843-c93f-458c-a56c-d20cbde8f8fd req-9d2c271e-b36f-49cf-a7d7-e2bf0b606cdc service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:42.427783 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-ee8d8843-c93f-458c-a56c-d20cbde8f8fd req-9d2c271e-b36f-49cf-a7d7-e2bf0b606cdc service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:42.439554 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-ee8d8843-c93f-458c-a56c-d20cbde8f8fd req-9d2c271e-b36f-49cf-a7d7-e2bf0b606cdc service nova] Creating event network-changed:476d0433-5310-435b-93ea-c42ed83c3136 for instance 0ed5ced2-87ad-4d0f-860c-648bcca91ca8 on hv-cinder-78481 Aug 12 01:28:42.445171 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-ee8d8843-c93f-458c-a56c-d20cbde8f8fd req-9d2c271e-b36f-49cf-a7d7-e2bf0b606cdc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032304 Aug 12 01:28:42.445398 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-19716a77-d461-4147-b48b-01342a363071 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:42.446074 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 36/77] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:28:42.451694 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-792e35ba-9a46-4ba3-ba59-4839c50a5d4a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:42.452280 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-792e35ba-9a46-4ba3-ba59-4839c50a5d4a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:42.456244 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-19716a77-d461-4147-b48b-01342a363071 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1362 microversion: 2.1 time: 0.458955 Aug 12 01:28:42.457010 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 42/78] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:41 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1362 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:42.458936 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-792e35ba-9a46-4ba3-ba59-4839c50a5d4a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:42.459409 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-792e35ba-9a46-4ba3-ba59-4839c50a5d4a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:42.459857 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-792e35ba-9a46-4ba3-ba59-4839c50a5d4a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:42.460540 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-792e35ba-9a46-4ba3-ba59-4839c50a5d4a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:42.461133 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-792e35ba-9a46-4ba3-ba59-4839c50a5d4a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:42.461698 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-792e35ba-9a46-4ba3-ba59-4839c50a5d4a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:42.477935 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-b3f84f29-965a-4b85-adcf-9c23c2a34e23 req-86f8c5e2-a5b2-4036-8ed8-186fc9b74951 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4364ac0-a9b7-4650-8456-15ccdd39bc3a", "tag": "4e439648-a2fe-49f9-a809-a2ad4090be7d"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:28:42.487758 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-b3f84f29-965a-4b85-adcf-9c23c2a34e23 req-86f8c5e2-a5b2-4036-8ed8-186fc9b74951 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:42.488958 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-b3f84f29-965a-4b85-adcf-9c23c2a34e23 req-86f8c5e2-a5b2-4036-8ed8-186fc9b74951 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:42.489714 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-b3f84f29-965a-4b85-adcf-9c23c2a34e23 req-86f8c5e2-a5b2-4036-8ed8-186fc9b74951 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:42.504976 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-b3f84f29-965a-4b85-adcf-9c23c2a34e23 req-86f8c5e2-a5b2-4036-8ed8-186fc9b74951 service nova] Creating event network-changed:4e439648-a2fe-49f9-a809-a2ad4090be7d for instance c4364ac0-a9b7-4650-8456-15ccdd39bc3a on hv-cinder-78481 Aug 12 01:28:42.510138 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-b3f84f29-965a-4b85-adcf-9c23c2a34e23 req-86f8c5e2-a5b2-4036-8ed8-186fc9b74951 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037527 Aug 12 01:28:42.514519 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 43/79] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:28:42.521009 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-6592fa39-65ed-4449-81ac-f26c00bd1bfe tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:42.523066 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-6592fa39-65ed-4449-81ac-f26c00bd1bfe tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:42.531051 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6592fa39-65ed-4449-81ac-f26c00bd1bfe tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:42.531762 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6592fa39-65ed-4449-81ac-f26c00bd1bfe tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:42.532333 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6592fa39-65ed-4449-81ac-f26c00bd1bfe tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:42.533178 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6592fa39-65ed-4449-81ac-f26c00bd1bfe tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:42.533629 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6592fa39-65ed-4449-81ac-f26c00bd1bfe tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:42.534219 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6592fa39-65ed-4449-81ac-f26c00bd1bfe tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:42.685375 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-792e35ba-9a46-4ba3-ba59-4839c50a5d4a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:42.695351 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-792e35ba-9a46-4ba3-ba59-4839c50a5d4a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1322 microversion: 2.1 time: 0.247964 Aug 12 01:28:42.696613 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 37/80] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:42 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:42.743566 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-6592fa39-65ed-4449-81ac-f26c00bd1bfe tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:42.752730 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-6592fa39-65ed-4449-81ac-f26c00bd1bfe tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9" status: 200 len: 1367 microversion: 2.1 time: 0.235871 Aug 12 01:28:42.753990 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 44/81] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:42 2022] GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:42.805246 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-80508beb-3dec-49b1-b6bf-7a8179e95296 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:42.805971 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-80508beb-3dec-49b1-b6bf-7a8179e95296 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:42.815779 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-80508beb-3dec-49b1-b6bf-7a8179e95296 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:42.816390 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-80508beb-3dec-49b1-b6bf-7a8179e95296 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:42.818103 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-80508beb-3dec-49b1-b6bf-7a8179e95296 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:42.819569 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-80508beb-3dec-49b1-b6bf-7a8179e95296 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:42.820114 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-80508beb-3dec-49b1-b6bf-7a8179e95296 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:42.820604 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-80508beb-3dec-49b1-b6bf-7a8179e95296 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:42.985318 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-80508beb-3dec-49b1-b6bf-7a8179e95296 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:42.993571 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-80508beb-3dec-49b1-b6bf-7a8179e95296 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:42.995064 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-80508beb-3dec-49b1-b6bf-7a8179e95296 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:42.996642 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-80508beb-3dec-49b1-b6bf-7a8179e95296 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1407 microversion: 2.20 time: 0.197899 Aug 12 01:28:42.997206 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 38/82] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:28:42 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:28:43.434655 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-b839ff50-d8d4-489a-98e5-7b689adb6e7b tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:43.435912 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-b839ff50-d8d4-489a-98e5-7b689adb6e7b tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] [instance: 26be209b-84c3-49e2-a869-ea8c00f94851] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:43.449070 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b839ff50-d8d4-489a-98e5-7b689adb6e7b tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:43.449709 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b839ff50-d8d4-489a-98e5-7b689adb6e7b tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:43.449975 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b839ff50-d8d4-489a-98e5-7b689adb6e7b tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:43.452411 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b839ff50-d8d4-489a-98e5-7b689adb6e7b tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:43.453045 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b839ff50-d8d4-489a-98e5-7b689adb6e7b tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:43.453916 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b839ff50-d8d4-489a-98e5-7b689adb6e7b tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:43.479949 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-06ca1eb1-a7d0-49e8-9519-4fde25eafdb8 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:43.480522 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-06ca1eb1-a7d0-49e8-9519-4fde25eafdb8 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:43.488333 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-06ca1eb1-a7d0-49e8-9519-4fde25eafdb8 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:43.492484 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-06ca1eb1-a7d0-49e8-9519-4fde25eafdb8 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:43.492930 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-06ca1eb1-a7d0-49e8-9519-4fde25eafdb8 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:43.493648 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-06ca1eb1-a7d0-49e8-9519-4fde25eafdb8 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:43.494097 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-06ca1eb1-a7d0-49e8-9519-4fde25eafdb8 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:43.494510 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-06ca1eb1-a7d0-49e8-9519-4fde25eafdb8 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:43.781272 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-b839ff50-d8d4-489a-98e5-7b689adb6e7b tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023a04369b394bd1b035ab793e0b93b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf0858834c84aaa993de55f361d6ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:43.793265 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-b839ff50-d8d4-489a-98e5-7b689adb6e7b tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] 10.222.0.20 "GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851" status: 200 len: 1315 microversion: 2.1 time: 0.363428 Aug 12 01:28:43.797222 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-06ca1eb1-a7d0-49e8-9519-4fde25eafdb8 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:43.804829 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-06ca1eb1-a7d0-49e8-9519-4fde25eafdb8 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1362 microversion: 2.1 time: 0.330666 Aug 12 01:28:43.805383 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 39/83] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:43 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1362 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:28:43.808812 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 45/84] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:43 2022] GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851 => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:43.810499 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-5e8bdaf6-cc22-4da9-a449-dadb1fbf3ce3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:43.811252 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-5e8bdaf6-cc22-4da9-a449-dadb1fbf3ce3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:43.813914 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-8b0ab023-64d1-4cf0-b6ec-b70311a1c85f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:43.814527 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-8b0ab023-64d1-4cf0-b6ec-b70311a1c85f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:43.818237 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5e8bdaf6-cc22-4da9-a449-dadb1fbf3ce3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:43.819090 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5e8bdaf6-cc22-4da9-a449-dadb1fbf3ce3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:43.820016 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5e8bdaf6-cc22-4da9-a449-dadb1fbf3ce3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:43.821006 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8b0ab023-64d1-4cf0-b6ec-b70311a1c85f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:43.821263 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5e8bdaf6-cc22-4da9-a449-dadb1fbf3ce3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:43.821568 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8b0ab023-64d1-4cf0-b6ec-b70311a1c85f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:43.822132 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5e8bdaf6-cc22-4da9-a449-dadb1fbf3ce3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:43.822240 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8b0ab023-64d1-4cf0-b6ec-b70311a1c85f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:43.822865 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8b0ab023-64d1-4cf0-b6ec-b70311a1c85f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:43.822970 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5e8bdaf6-cc22-4da9-a449-dadb1fbf3ce3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:43.823307 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8b0ab023-64d1-4cf0-b6ec-b70311a1c85f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:43.823803 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8b0ab023-64d1-4cf0-b6ec-b70311a1c85f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:44.064554 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-8b0ab023-64d1-4cf0-b6ec-b70311a1c85f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:44.068049 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-5e8bdaf6-cc22-4da9-a449-dadb1fbf3ce3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:44.077362 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-8b0ab023-64d1-4cf0-b6ec-b70311a1c85f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9" status: 200 len: 1367 microversion: 2.1 time: 0.267153 Aug 12 01:28:44.079456 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 46/85] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:43 2022] GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:44.088998 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-90b01d7b-ffaa-45e9-83c7-a1e5a1708972 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:44.091011 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-90b01d7b-ffaa-45e9-83c7-a1e5a1708972 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:44.094303 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-5e8bdaf6-cc22-4da9-a449-dadb1fbf3ce3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1322 microversion: 2.1 time: 0.287586 Aug 12 01:28:44.107562 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 40/86] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:43 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:44.107744 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-90b01d7b-ffaa-45e9-83c7-a1e5a1708972 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:44.107744 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-90b01d7b-ffaa-45e9-83c7-a1e5a1708972 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:44.107744 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-90b01d7b-ffaa-45e9-83c7-a1e5a1708972 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:44.107744 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-90b01d7b-ffaa-45e9-83c7-a1e5a1708972 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:44.108118 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-90b01d7b-ffaa-45e9-83c7-a1e5a1708972 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:44.108118 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-90b01d7b-ffaa-45e9-83c7-a1e5a1708972 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:44.325627 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-90b01d7b-ffaa-45e9-83c7-a1e5a1708972 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:44.336100 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-90b01d7b-ffaa-45e9-83c7-a1e5a1708972 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:44.337549 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-90b01d7b-ffaa-45e9-83c7-a1e5a1708972 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:44.338763 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-90b01d7b-ffaa-45e9-83c7-a1e5a1708972 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1407 microversion: 2.20 time: 0.258035 Aug 12 01:28:44.351561 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 47/87] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:28:44 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:28:44.814906 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-47380fc6-a92e-488b-b9ce-e8c6017da2d6 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:44.815505 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-47380fc6-a92e-488b-b9ce-e8c6017da2d6 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] [instance: 26be209b-84c3-49e2-a869-ea8c00f94851] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:44.824731 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-47380fc6-a92e-488b-b9ce-e8c6017da2d6 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:44.825491 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-47380fc6-a92e-488b-b9ce-e8c6017da2d6 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:44.826833 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-47380fc6-a92e-488b-b9ce-e8c6017da2d6 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:44.828132 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-e2f594b4-60a7-4b97-85b6-76857897c582 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:44.829382 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-e2f594b4-60a7-4b97-85b6-76857897c582 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:44.829536 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-47380fc6-a92e-488b-b9ce-e8c6017da2d6 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:44.830944 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-47380fc6-a92e-488b-b9ce-e8c6017da2d6 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:44.831387 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-47380fc6-a92e-488b-b9ce-e8c6017da2d6 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:44.841575 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e2f594b4-60a7-4b97-85b6-76857897c582 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:44.842253 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e2f594b4-60a7-4b97-85b6-76857897c582 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:44.842949 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e2f594b4-60a7-4b97-85b6-76857897c582 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:44.843820 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e2f594b4-60a7-4b97-85b6-76857897c582 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:44.844400 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e2f594b4-60a7-4b97-85b6-76857897c582 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:44.844951 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e2f594b4-60a7-4b97-85b6-76857897c582 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:45.277420 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-47380fc6-a92e-488b-b9ce-e8c6017da2d6 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023a04369b394bd1b035ab793e0b93b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf0858834c84aaa993de55f361d6ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:45.288799 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-47380fc6-a92e-488b-b9ce-e8c6017da2d6 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] 10.222.0.20 "GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851" status: 200 len: 1315 microversion: 2.1 time: 0.476954 Aug 12 01:28:45.290865 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 41/88] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:44 2022] GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851 => generated 1315 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:45.306948 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-94447448-2c6f-4b47-b8a5-075185331d16 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:45.308987 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-94447448-2c6f-4b47-b8a5-075185331d16 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:45.331510 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-94447448-2c6f-4b47-b8a5-075185331d16 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:45.336134 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-94447448-2c6f-4b47-b8a5-075185331d16 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:45.336971 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-94447448-2c6f-4b47-b8a5-075185331d16 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:45.337831 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-94447448-2c6f-4b47-b8a5-075185331d16 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:45.338409 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-94447448-2c6f-4b47-b8a5-075185331d16 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:45.338998 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-94447448-2c6f-4b47-b8a5-075185331d16 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:45.653011 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-e2f594b4-60a7-4b97-85b6-76857897c582 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:45.662602 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-e2f594b4-60a7-4b97-85b6-76857897c582 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1362 microversion: 2.1 time: 0.838008 Aug 12 01:28:45.680881 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 48/89] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:44 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1362 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:28:45.689257 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-dfd7c61f-6369-4a4e-8ca3-8e607412834b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:45.689880 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-dfd7c61f-6369-4a4e-8ca3-8e607412834b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:45.700996 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-94447448-2c6f-4b47-b8a5-075185331d16 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:45.702986 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dfd7c61f-6369-4a4e-8ca3-8e607412834b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:45.703625 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dfd7c61f-6369-4a4e-8ca3-8e607412834b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:45.705011 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dfd7c61f-6369-4a4e-8ca3-8e607412834b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:45.707245 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dfd7c61f-6369-4a4e-8ca3-8e607412834b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:45.709088 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dfd7c61f-6369-4a4e-8ca3-8e607412834b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:45.709928 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dfd7c61f-6369-4a4e-8ca3-8e607412834b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:45.712740 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-94447448-2c6f-4b47-b8a5-075185331d16 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9" status: 200 len: 1367 microversion: 2.1 time: 0.419819 Aug 12 01:28:45.715117 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 42/90] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:45 2022] GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 => generated 1367 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:45.721653 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-cd619af5-3670-48aa-a0a3-cf5a03a59fa1 req-6155628d-c108-436c-93f0-76719e430cc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2961f2a6-2c42-46af-8a74-98a8692ef170", "name": "network-vif-plugged", "status": "completed", "tag": "62bb6f5f-1dc9-4675-9d96-12163b24d167"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:28:45.732379 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-cd619af5-3670-48aa-a0a3-cf5a03a59fa1 req-6155628d-c108-436c-93f0-76719e430cc1 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:45.733187 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-cd619af5-3670-48aa-a0a3-cf5a03a59fa1 req-6155628d-c108-436c-93f0-76719e430cc1 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:45.733802 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-cd619af5-3670-48aa-a0a3-cf5a03a59fa1 req-6155628d-c108-436c-93f0-76719e430cc1 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:45.749305 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-cd619af5-3670-48aa-a0a3-cf5a03a59fa1 req-6155628d-c108-436c-93f0-76719e430cc1 service nova] Creating event network-vif-plugged:62bb6f5f-1dc9-4675-9d96-12163b24d167 for instance 2961f2a6-2c42-46af-8a74-98a8692ef170 on hv-cinder-78481 Aug 12 01:28:45.754983 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-cd619af5-3670-48aa-a0a3-cf5a03a59fa1 req-6155628d-c108-436c-93f0-76719e430cc1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037712 Aug 12 01:28:45.755919 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 43/91] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:28:45.761663 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-0c03702c-3d2f-4698-bb5c-3f0b0b98d3b2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:45.762688 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-0c03702c-3d2f-4698-bb5c-3f0b0b98d3b2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:45.771444 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0c03702c-3d2f-4698-bb5c-3f0b0b98d3b2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:45.772145 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0c03702c-3d2f-4698-bb5c-3f0b0b98d3b2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:45.772677 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0c03702c-3d2f-4698-bb5c-3f0b0b98d3b2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:45.773717 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0c03702c-3d2f-4698-bb5c-3f0b0b98d3b2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:45.774269 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0c03702c-3d2f-4698-bb5c-3f0b0b98d3b2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:45.774786 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0c03702c-3d2f-4698-bb5c-3f0b0b98d3b2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:45.998917 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-dfd7c61f-6369-4a4e-8ca3-8e607412834b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:46.013028 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-dfd7c61f-6369-4a4e-8ca3-8e607412834b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1322 microversion: 2.1 time: 0.330302 Aug 12 01:28:46.013623 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 49/92] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:45 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1322 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:46.029123 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-0c03702c-3d2f-4698-bb5c-3f0b0b98d3b2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:46.041922 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-0c03702c-3d2f-4698-bb5c-3f0b0b98d3b2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:46.043436 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-0c03702c-3d2f-4698-bb5c-3f0b0b98d3b2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:46.044948 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-0c03702c-3d2f-4698-bb5c-3f0b0b98d3b2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1407 microversion: 2.20 time: 0.287559 Aug 12 01:28:46.046285 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 44/93] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:28:45 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1407 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:28:46.316179 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-882a678c-7c7c-425e-8638-008e8aac7de7 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:46.317832 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-882a678c-7c7c-425e-8638-008e8aac7de7 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] [instance: 26be209b-84c3-49e2-a869-ea8c00f94851] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:46.331662 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-882a678c-7c7c-425e-8638-008e8aac7de7 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:46.332194 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-882a678c-7c7c-425e-8638-008e8aac7de7 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:46.332627 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-882a678c-7c7c-425e-8638-008e8aac7de7 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:46.333543 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-882a678c-7c7c-425e-8638-008e8aac7de7 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:46.334047 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-882a678c-7c7c-425e-8638-008e8aac7de7 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:46.334597 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-882a678c-7c7c-425e-8638-008e8aac7de7 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:46.535200 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-882a678c-7c7c-425e-8638-008e8aac7de7 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023a04369b394bd1b035ab793e0b93b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf0858834c84aaa993de55f361d6ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:46.541137 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-882a678c-7c7c-425e-8638-008e8aac7de7 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] 10.222.0.20 "GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851" status: 200 len: 1315 microversion: 2.1 time: 0.234967 Aug 12 01:28:46.547598 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 50/94] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:46 2022] GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:46.700823 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-7e4fe530-6f5b-48ea-bf47-073eb4df142b tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:46.703111 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-7e4fe530-6f5b-48ea-bf47-073eb4df142b tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:46.712607 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell0:SELECT=8 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:28:46.719601 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7e4fe530-6f5b-48ea-bf47-073eb4df142b tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:46.720339 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7e4fe530-6f5b-48ea-bf47-073eb4df142b tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:46.720977 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7e4fe530-6f5b-48ea-bf47-073eb4df142b tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:46.722060 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7e4fe530-6f5b-48ea-bf47-073eb4df142b tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:46.722841 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7e4fe530-6f5b-48ea-bf47-073eb4df142b tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:46.740374 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-4ae5c064-071b-4c1a-b4e0-3c0ae6a54dfd tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:46.740374 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-4ae5c064-071b-4c1a-b4e0-3c0ae6a54dfd tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:46.745675 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4ae5c064-071b-4c1a-b4e0-3c0ae6a54dfd tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:46.748147 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7e4fe530-6f5b-48ea-bf47-073eb4df142b tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:46.761437 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4ae5c064-071b-4c1a-b4e0-3c0ae6a54dfd tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:46.761941 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4ae5c064-071b-4c1a-b4e0-3c0ae6a54dfd tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:46.763414 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4ae5c064-071b-4c1a-b4e0-3c0ae6a54dfd tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:46.763939 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4ae5c064-071b-4c1a-b4e0-3c0ae6a54dfd tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:46.765641 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4ae5c064-071b-4c1a-b4e0-3c0ae6a54dfd tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:47.234889 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-4ae5c064-071b-4c1a-b4e0-3c0ae6a54dfd tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:47.240105 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-7e4fe530-6f5b-48ea-bf47-073eb4df142b tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:47.258411 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-4ae5c064-071b-4c1a-b4e0-3c0ae6a54dfd tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9" status: 200 len: 1367 microversion: 2.1 time: 0.526443 Aug 12 01:28:47.259022 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 51/95] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:46 2022] GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 => generated 1367 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:47.260366 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-7e4fe530-6f5b-48ea-bf47-073eb4df142b tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1362 microversion: 2.1 time: 0.570588 Aug 12 01:28:47.260963 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 45/96] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:46 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1362 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:47.278110 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-1244fd75-dc8d-4372-b8cf-a20f49a71b18 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:47.278758 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-1244fd75-dc8d-4372-b8cf-a20f49a71b18 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:47.286928 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1244fd75-dc8d-4372-b8cf-a20f49a71b18 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:47.287258 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1244fd75-dc8d-4372-b8cf-a20f49a71b18 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:47.288020 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1244fd75-dc8d-4372-b8cf-a20f49a71b18 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:47.289027 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1244fd75-dc8d-4372-b8cf-a20f49a71b18 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:47.289512 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1244fd75-dc8d-4372-b8cf-a20f49a71b18 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:47.289930 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1244fd75-dc8d-4372-b8cf-a20f49a71b18 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:47.291512 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-40608e4d-9503-4825-8bde-e64ec4b7c8f1 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:47.292420 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-40608e4d-9503-4825-8bde-e64ec4b7c8f1 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:47.295975 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell1:SELECT=100 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:28:47.326543 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-40608e4d-9503-4825-8bde-e64ec4b7c8f1 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:47.328446 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-40608e4d-9503-4825-8bde-e64ec4b7c8f1 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:47.330834 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-40608e4d-9503-4825-8bde-e64ec4b7c8f1 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:47.335360 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-40608e4d-9503-4825-8bde-e64ec4b7c8f1 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:47.337126 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-40608e4d-9503-4825-8bde-e64ec4b7c8f1 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:47.337806 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-40608e4d-9503-4825-8bde-e64ec4b7c8f1 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:47.827704 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-1244fd75-dc8d-4372-b8cf-a20f49a71b18 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:47.835314 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-1244fd75-dc8d-4372-b8cf-a20f49a71b18 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1322 microversion: 2.1 time: 0.575271 Aug 12 01:28:47.845631 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-40608e4d-9503-4825-8bde-e64ec4b7c8f1 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:47.849476 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 52/97] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:47 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1322 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:47.856139 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-40608e4d-9503-4825-8bde-e64ec4b7c8f1 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:47.857331 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-40608e4d-9503-4825-8bde-e64ec4b7c8f1 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:47.861314 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-3a629206-69ab-4c35-a9d4-d51d0cb1a552 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:47.861931 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-3a629206-69ab-4c35-a9d4-d51d0cb1a552 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] [instance: 26be209b-84c3-49e2-a869-ea8c00f94851] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:47.866067 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-40608e4d-9503-4825-8bde-e64ec4b7c8f1 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1407 microversion: 2.20 time: 0.603341 Aug 12 01:28:47.880057 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3a629206-69ab-4c35-a9d4-d51d0cb1a552 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:47.880057 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3a629206-69ab-4c35-a9d4-d51d0cb1a552 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:47.880057 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3a629206-69ab-4c35-a9d4-d51d0cb1a552 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:47.880057 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3a629206-69ab-4c35-a9d4-d51d0cb1a552 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:47.880405 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3a629206-69ab-4c35-a9d4-d51d0cb1a552 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:47.880405 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3a629206-69ab-4c35-a9d4-d51d0cb1a552 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:47.881205 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 46/98] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:28:47 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1407 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:28:47.886411 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-a6c9477a-1644-4aa5-b38c-66f7b4993798 req-fb4c32ad-6a04-420c-b34e-892d5e9245fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26be209b-84c3-49e2-a869-ea8c00f94851", "name": "network-vif-plugged", "status": "completed", "tag": "e88a4d4f-78ca-43d6-9412-606c68ca8ff1"}, {"server_uuid": "c4364ac0-a9b7-4650-8456-15ccdd39bc3a", "name": "network-vif-plugged", "status": "completed", "tag": "4e439648-a2fe-49f9-a809-a2ad4090be7d"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:28:47.901194 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-a6c9477a-1644-4aa5-b38c-66f7b4993798 req-fb4c32ad-6a04-420c-b34e-892d5e9245fc service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:47.901895 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-a6c9477a-1644-4aa5-b38c-66f7b4993798 req-fb4c32ad-6a04-420c-b34e-892d5e9245fc service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:47.902492 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-a6c9477a-1644-4aa5-b38c-66f7b4993798 req-fb4c32ad-6a04-420c-b34e-892d5e9245fc service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:47.918100 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-a6c9477a-1644-4aa5-b38c-66f7b4993798 req-fb4c32ad-6a04-420c-b34e-892d5e9245fc service nova] Creating event network-vif-plugged:e88a4d4f-78ca-43d6-9412-606c68ca8ff1 for instance 26be209b-84c3-49e2-a869-ea8c00f94851 on hv-cinder-78481 Aug 12 01:28:47.918907 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-a6c9477a-1644-4aa5-b38c-66f7b4993798 req-fb4c32ad-6a04-420c-b34e-892d5e9245fc service nova] Creating event network-vif-plugged:4e439648-a2fe-49f9-a809-a2ad4090be7d for instance c4364ac0-a9b7-4650-8456-15ccdd39bc3a on hv-cinder-78481 Aug 12 01:28:47.952665 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-a6c9477a-1644-4aa5-b38c-66f7b4993798 req-fb4c32ad-6a04-420c-b34e-892d5e9245fc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.069794 Aug 12 01:28:47.953541 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 47/99] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:28:48.131598 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-3a629206-69ab-4c35-a9d4-d51d0cb1a552 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023a04369b394bd1b035ab793e0b93b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf0858834c84aaa993de55f361d6ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:48.141127 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-3a629206-69ab-4c35-a9d4-d51d0cb1a552 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] 10.222.0.20 "GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851" status: 200 len: 1315 microversion: 2.1 time: 0.290499 Aug 12 01:28:48.141788 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 53/100] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:47 2022] GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851 => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:48.288256 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-ad25521c-a7e9-4db5-900d-5dade61f9f26 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:48.289031 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-e39a7144-4726-4a8a-a3b6-ddfcd9dc0fbf tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:48.289738 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-ad25521c-a7e9-4db5-900d-5dade61f9f26 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:48.290640 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-e39a7144-4726-4a8a-a3b6-ddfcd9dc0fbf tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:48.309061 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ad25521c-a7e9-4db5-900d-5dade61f9f26 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:48.310812 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e39a7144-4726-4a8a-a3b6-ddfcd9dc0fbf tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:48.314059 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ad25521c-a7e9-4db5-900d-5dade61f9f26 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:48.315625 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e39a7144-4726-4a8a-a3b6-ddfcd9dc0fbf tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:48.316265 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ad25521c-a7e9-4db5-900d-5dade61f9f26 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:48.318125 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e39a7144-4726-4a8a-a3b6-ddfcd9dc0fbf tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:48.320676 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ad25521c-a7e9-4db5-900d-5dade61f9f26 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:48.322628 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ad25521c-a7e9-4db5-900d-5dade61f9f26 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:48.323087 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e39a7144-4726-4a8a-a3b6-ddfcd9dc0fbf tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:48.324457 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e39a7144-4726-4a8a-a3b6-ddfcd9dc0fbf tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:48.324907 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e39a7144-4726-4a8a-a3b6-ddfcd9dc0fbf tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:48.326476 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ad25521c-a7e9-4db5-900d-5dade61f9f26 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:48.603340 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-e39a7144-4726-4a8a-a3b6-ddfcd9dc0fbf tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:48.616691 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-ad25521c-a7e9-4db5-900d-5dade61f9f26 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:48.621156 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-e39a7144-4726-4a8a-a3b6-ddfcd9dc0fbf tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1362 microversion: 2.1 time: 0.335554 Aug 12 01:28:48.625657 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-ad25521c-a7e9-4db5-900d-5dade61f9f26 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9" status: 200 len: 1367 microversion: 2.1 time: 0.346008 Aug 12 01:28:48.639600 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 48/101] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:48 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1362 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:48.640581 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 54/102] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:48 2022] GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 => generated 1367 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:28:48.860777 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-1c1628d6-0976-499c-85df-6f55355cb03f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:48.861391 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-1c1628d6-0976-499c-85df-6f55355cb03f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:48.867609 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1c1628d6-0976-499c-85df-6f55355cb03f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:48.868102 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1c1628d6-0976-499c-85df-6f55355cb03f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:48.868521 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1c1628d6-0976-499c-85df-6f55355cb03f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:48.869212 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1c1628d6-0976-499c-85df-6f55355cb03f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:48.869680 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1c1628d6-0976-499c-85df-6f55355cb03f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:48.870252 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1c1628d6-0976-499c-85df-6f55355cb03f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:48.895933 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-7cc6d46c-6b83-445d-9313-76e881b433bd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:48.896828 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-7cc6d46c-6b83-445d-9313-76e881b433bd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:48.903284 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7cc6d46c-6b83-445d-9313-76e881b433bd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:48.904344 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7cc6d46c-6b83-445d-9313-76e881b433bd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:48.904344 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7cc6d46c-6b83-445d-9313-76e881b433bd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:48.904872 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7cc6d46c-6b83-445d-9313-76e881b433bd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:48.905496 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7cc6d46c-6b83-445d-9313-76e881b433bd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:48.905912 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7cc6d46c-6b83-445d-9313-76e881b433bd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:49.089922 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-1c1628d6-0976-499c-85df-6f55355cb03f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:49.094860 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-7cc6d46c-6b83-445d-9313-76e881b433bd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:49.099914 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-1c1628d6-0976-499c-85df-6f55355cb03f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1515 microversion: 2.1 time: 0.241735 Aug 12 01:28:49.103415 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 49/103] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:48 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1515 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:49.104354 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-7cc6d46c-6b83-445d-9313-76e881b433bd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:49.106202 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-7cc6d46c-6b83-445d-9313-76e881b433bd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:49.107780 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-7cc6d46c-6b83-445d-9313-76e881b433bd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1407 microversion: 2.20 time: 0.215839 Aug 12 01:28:49.108507 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 55/104] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:28:48 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:28:49.129703 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-73646fa4-7eda-4089-a675-a73451637c1f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:28:49.132038 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-73646fa4-7eda-4089-a675-a73451637c1f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:49.140533 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-73646fa4-7eda-4089-a675-a73451637c1f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:49.141025 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-73646fa4-7eda-4089-a675-a73451637c1f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:49.141608 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-73646fa4-7eda-4089-a675-a73451637c1f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:49.142506 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-73646fa4-7eda-4089-a675-a73451637c1f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:49.143156 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-73646fa4-7eda-4089-a675-a73451637c1f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:49.143603 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-73646fa4-7eda-4089-a675-a73451637c1f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:49.161802 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-8b39f0d5-47ed-4a88-9424-5ca439bb890d tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:49.162416 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-8b39f0d5-47ed-4a88-9424-5ca439bb890d tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] [instance: 26be209b-84c3-49e2-a869-ea8c00f94851] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:49.169368 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8b39f0d5-47ed-4a88-9424-5ca439bb890d tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:49.169853 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8b39f0d5-47ed-4a88-9424-5ca439bb890d tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:49.171979 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8b39f0d5-47ed-4a88-9424-5ca439bb890d tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:49.174693 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8b39f0d5-47ed-4a88-9424-5ca439bb890d tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:49.177269 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8b39f0d5-47ed-4a88-9424-5ca439bb890d tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:49.179213 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8b39f0d5-47ed-4a88-9424-5ca439bb890d tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:49.237375 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.objects.instance [None req-73646fa4-7eda-4089-a675-a73451637c1f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lazy-loading 'flavor' on Instance uuid 2961f2a6-2c42-46af-8a74-98a8692ef170 {{(pid=120785) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 01:28:49.333114 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-8b39f0d5-47ed-4a88-9424-5ca439bb890d tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023a04369b394bd1b035ab793e0b93b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf0858834c84aaa993de55f361d6ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:49.341429 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-8b39f0d5-47ed-4a88-9424-5ca439bb890d tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] 10.222.0.20 "GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851" status: 200 len: 1315 microversion: 2.1 time: 0.183799 Aug 12 01:28:49.347659 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 56/105] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:49 2022] GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:28:49.378381 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-73646fa4-7eda-4089-a675-a73451637c1f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "POST /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170/action" status: 200 len: 32 microversion: 2.1 time: 0.252972 Aug 12 01:28:49.379387 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 50/106] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Aug 12 01:28:49 2022] POST /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170/action => generated 32 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 01:28:49.390838 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-7d2005fe-ec28-4e76-8a5f-23ba77ef9a91 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:49.391592 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-7d2005fe-ec28-4e76-8a5f-23ba77ef9a91 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:49.397656 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7d2005fe-ec28-4e76-8a5f-23ba77ef9a91 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:49.398228 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7d2005fe-ec28-4e76-8a5f-23ba77ef9a91 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:49.398789 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7d2005fe-ec28-4e76-8a5f-23ba77ef9a91 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:49.399485 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7d2005fe-ec28-4e76-8a5f-23ba77ef9a91 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:49.400091 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7d2005fe-ec28-4e76-8a5f-23ba77ef9a91 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:49.400527 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7d2005fe-ec28-4e76-8a5f-23ba77ef9a91 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:49.537439 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-7d2005fe-ec28-4e76-8a5f-23ba77ef9a91 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:49.545182 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-7d2005fe-ec28-4e76-8a5f-23ba77ef9a91 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.158421 Aug 12 01:28:49.546082 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 57/107] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:49 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:49.648090 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-edd3d232-0272-4017-8b60-656e43a80747 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:49.648902 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-edd3d232-0272-4017-8b60-656e43a80747 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:49.656831 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-edd3d232-0272-4017-8b60-656e43a80747 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:49.657320 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-edd3d232-0272-4017-8b60-656e43a80747 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:49.657752 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-edd3d232-0272-4017-8b60-656e43a80747 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:49.658452 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-edd3d232-0272-4017-8b60-656e43a80747 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:49.658896 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-edd3d232-0272-4017-8b60-656e43a80747 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:49.659309 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-edd3d232-0272-4017-8b60-656e43a80747 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:49.660598 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-65d0c477-ca68-44fa-b5c4-ced767a1a8c5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:49.661766 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-65d0c477-ca68-44fa-b5c4-ced767a1a8c5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:49.674594 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-65d0c477-ca68-44fa-b5c4-ced767a1a8c5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:49.675103 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-65d0c477-ca68-44fa-b5c4-ced767a1a8c5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:49.675648 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-65d0c477-ca68-44fa-b5c4-ced767a1a8c5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:49.676437 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-65d0c477-ca68-44fa-b5c4-ced767a1a8c5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:49.676951 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-65d0c477-ca68-44fa-b5c4-ced767a1a8c5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:49.677397 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-65d0c477-ca68-44fa-b5c4-ced767a1a8c5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:49.957031 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-65d0c477-ca68-44fa-b5c4-ced767a1a8c5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:49.970098 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-65d0c477-ca68-44fa-b5c4-ced767a1a8c5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9" status: 200 len: 1367 microversion: 2.1 time: 0.313055 Aug 12 01:28:49.970780 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 58/108] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:49 2022] GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 => generated 1367 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:49.979157 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-edd3d232-0272-4017-8b60-656e43a80747 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:49.989518 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-edd3d232-0272-4017-8b60-656e43a80747 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1362 microversion: 2.1 time: 0.346605 Aug 12 01:28:49.990212 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 51/109] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:49 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1362 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:50.027450 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-f2cfaa3b-60f0-4feb-a579-422535d08947 req-07f97b4c-8c14-4a26-bb68-f2adf454a517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da106e4a-1bc6-4e68-ac0c-1a2ca899daa9", "name": "network-vif-plugged", "status": "completed", "tag": "941dd4d7-4c16-4fb4-aa93-79972bef7581"}, {"server_uuid": "0ed5ced2-87ad-4d0f-860c-648bcca91ca8", "name": "network-vif-plugged", "status": "completed", "tag": "476d0433-5310-435b-93ea-c42ed83c3136"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:28:50.038481 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-f2cfaa3b-60f0-4feb-a579-422535d08947 req-07f97b4c-8c14-4a26-bb68-f2adf454a517 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:50.039100 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-f2cfaa3b-60f0-4feb-a579-422535d08947 req-07f97b4c-8c14-4a26-bb68-f2adf454a517 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:50.039551 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-f2cfaa3b-60f0-4feb-a579-422535d08947 req-07f97b4c-8c14-4a26-bb68-f2adf454a517 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:50.055077 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-f2cfaa3b-60f0-4feb-a579-422535d08947 req-07f97b4c-8c14-4a26-bb68-f2adf454a517 service nova] Creating event network-vif-plugged:941dd4d7-4c16-4fb4-aa93-79972bef7581 for instance da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 on hv-cinder-78481 Aug 12 01:28:50.056012 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-f2cfaa3b-60f0-4feb-a579-422535d08947 req-07f97b4c-8c14-4a26-bb68-f2adf454a517 service nova] Creating event network-vif-plugged:476d0433-5310-435b-93ea-c42ed83c3136 for instance 0ed5ced2-87ad-4d0f-860c-648bcca91ca8 on hv-cinder-78481 Aug 12 01:28:50.063483 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-f2cfaa3b-60f0-4feb-a579-422535d08947 req-07f97b4c-8c14-4a26-bb68-f2adf454a517 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040842 Aug 12 01:28:50.064527 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 59/110] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:28:50.138735 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-3d70ae5c-611e-4521-8925-b68823cdc44c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:50.139626 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-3d70ae5c-611e-4521-8925-b68823cdc44c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:50.146156 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3d70ae5c-611e-4521-8925-b68823cdc44c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:50.146632 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3d70ae5c-611e-4521-8925-b68823cdc44c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:50.147056 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3d70ae5c-611e-4521-8925-b68823cdc44c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:50.147767 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3d70ae5c-611e-4521-8925-b68823cdc44c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:50.148212 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3d70ae5c-611e-4521-8925-b68823cdc44c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:50.148621 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3d70ae5c-611e-4521-8925-b68823cdc44c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:50.173519 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:28:50.350667 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-3d70ae5c-611e-4521-8925-b68823cdc44c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:50.362692 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-3d70ae5c-611e-4521-8925-b68823cdc44c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:50.364322 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-3d70ae5c-611e-4521-8925-b68823cdc44c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:50.365814 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-3d70ae5c-611e-4521-8925-b68823cdc44c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1407 microversion: 2.20 time: 0.231080 Aug 12 01:28:50.366894 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 52/111] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:28:50 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:28:50.370059 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-a4ad258b-4e0d-40ef-985d-988d10df2b03 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:50.370962 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-a4ad258b-4e0d-40ef-985d-988d10df2b03 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] [instance: 26be209b-84c3-49e2-a869-ea8c00f94851] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:50.377997 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a4ad258b-4e0d-40ef-985d-988d10df2b03 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:50.379006 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a4ad258b-4e0d-40ef-985d-988d10df2b03 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:50.379702 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a4ad258b-4e0d-40ef-985d-988d10df2b03 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:50.380616 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a4ad258b-4e0d-40ef-985d-988d10df2b03 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:50.389805 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a4ad258b-4e0d-40ef-985d-988d10df2b03 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:50.391596 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a4ad258b-4e0d-40ef-985d-988d10df2b03 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:50.539060 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-a4ad258b-4e0d-40ef-985d-988d10df2b03 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023a04369b394bd1b035ab793e0b93b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf0858834c84aaa993de55f361d6ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:50.547957 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-a4ad258b-4e0d-40ef-985d-988d10df2b03 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] 10.222.0.20 "GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851" status: 200 len: 1501 microversion: 2.1 time: 0.182719 Aug 12 01:28:50.548639 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 60/112] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:50 2022] GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851 => generated 1501 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:50.567086 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-ba5ee801-1a4d-403f-bf1e-2f942be2c841 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:50.567853 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-ba5ee801-1a4d-403f-bf1e-2f942be2c841 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:50.573951 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ba5ee801-1a4d-403f-bf1e-2f942be2c841 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:50.574443 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ba5ee801-1a4d-403f-bf1e-2f942be2c841 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:50.574871 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ba5ee801-1a4d-403f-bf1e-2f942be2c841 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:50.576159 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ba5ee801-1a4d-403f-bf1e-2f942be2c841 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:50.577630 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ba5ee801-1a4d-403f-bf1e-2f942be2c841 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:50.578495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ba5ee801-1a4d-403f-bf1e-2f942be2c841 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:50.887814 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-ba5ee801-1a4d-403f-bf1e-2f942be2c841 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:50.898839 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-ba5ee801-1a4d-403f-bf1e-2f942be2c841 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.336230 Aug 12 01:28:50.899420 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 53/113] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:50 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:50.999315 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-b9197378-f001-4f18-8adb-6f027fcd5f42 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:51.005084 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-b9197378-f001-4f18-8adb-6f027fcd5f42 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:51.011445 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-99103180-fcaa-4ac0-a54b-cc36c6ec4547 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:51.012180 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-99103180-fcaa-4ac0-a54b-cc36c6ec4547 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:51.045084 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-99103180-fcaa-4ac0-a54b-cc36c6ec4547 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:51.045590 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-99103180-fcaa-4ac0-a54b-cc36c6ec4547 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:51.047559 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b9197378-f001-4f18-8adb-6f027fcd5f42 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:51.051642 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-99103180-fcaa-4ac0-a54b-cc36c6ec4547 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:51.052459 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-99103180-fcaa-4ac0-a54b-cc36c6ec4547 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:51.052974 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-99103180-fcaa-4ac0-a54b-cc36c6ec4547 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:51.053335 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-99103180-fcaa-4ac0-a54b-cc36c6ec4547 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:51.054709 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b9197378-f001-4f18-8adb-6f027fcd5f42 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:51.055192 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b9197378-f001-4f18-8adb-6f027fcd5f42 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:51.059062 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b9197378-f001-4f18-8adb-6f027fcd5f42 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:51.059595 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b9197378-f001-4f18-8adb-6f027fcd5f42 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:51.063389 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b9197378-f001-4f18-8adb-6f027fcd5f42 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:51.393799 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-b9197378-f001-4f18-8adb-6f027fcd5f42 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:51.405231 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-b9197378-f001-4f18-8adb-6f027fcd5f42 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9" status: 200 len: 1367 microversion: 2.1 time: 0.415936 Aug 12 01:28:51.407202 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 61/114] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:50 2022] GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 => generated 1367 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:51.413303 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-29e89be3-5d1a-4eb6-8e94-8508cc7c20ce tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:51.414421 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-29e89be3-5d1a-4eb6-8e94-8508cc7c20ce tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:51.421970 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-99103180-fcaa-4ac0-a54b-cc36c6ec4547 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:51.423182 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-29e89be3-5d1a-4eb6-8e94-8508cc7c20ce tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:51.424303 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-29e89be3-5d1a-4eb6-8e94-8508cc7c20ce tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:51.432524 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-99103180-fcaa-4ac0-a54b-cc36c6ec4547 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1362 microversion: 2.1 time: 0.425599 Aug 12 01:28:51.439903 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-29e89be3-5d1a-4eb6-8e94-8508cc7c20ce tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:51.441309 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-29e89be3-5d1a-4eb6-8e94-8508cc7c20ce tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:51.442637 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-29e89be3-5d1a-4eb6-8e94-8508cc7c20ce tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:51.443470 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-29e89be3-5d1a-4eb6-8e94-8508cc7c20ce tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:51.448188 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 54/115] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:51 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1362 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:28:51.598475 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-29e89be3-5d1a-4eb6-8e94-8508cc7c20ce tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:51.607445 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-29e89be3-5d1a-4eb6-8e94-8508cc7c20ce tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:51.609279 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-29e89be3-5d1a-4eb6-8e94-8508cc7c20ce tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:51.610423 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-29e89be3-5d1a-4eb6-8e94-8508cc7c20ce tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1407 microversion: 2.20 time: 0.201942 Aug 12 01:28:51.611075 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 62/116] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:28:51 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:28:51.920120 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-2ca34997-462b-4fce-af8d-44bd2f53aec7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:51.920747 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-2ca34997-462b-4fce-af8d-44bd2f53aec7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:51.926755 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2ca34997-462b-4fce-af8d-44bd2f53aec7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:51.927227 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2ca34997-462b-4fce-af8d-44bd2f53aec7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:51.927686 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2ca34997-462b-4fce-af8d-44bd2f53aec7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:51.928363 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2ca34997-462b-4fce-af8d-44bd2f53aec7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:51.928805 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2ca34997-462b-4fce-af8d-44bd2f53aec7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:51.929219 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2ca34997-462b-4fce-af8d-44bd2f53aec7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:52.060831 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-2ca34997-462b-4fce-af8d-44bd2f53aec7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:52.068336 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-2ca34997-462b-4fce-af8d-44bd2f53aec7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.152202 Aug 12 01:28:52.069216 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 55/117] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:51 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:52.214777 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-d736a57e-5cf2-4831-b693-6eef5001a6b6 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9868d788-a322-4a96-ba10-c4b71d94ee69"}} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:28:52.217204 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-d736a57e-5cf2-4831-b693-6eef5001a6b6 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] [instance: 26be209b-84c3-49e2-a869-ea8c00f94851] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:52.223155 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d736a57e-5cf2-4831-b693-6eef5001a6b6 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:52.223768 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d736a57e-5cf2-4831-b693-6eef5001a6b6 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:52.224193 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d736a57e-5cf2-4831-b693-6eef5001a6b6 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:52.224861 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d736a57e-5cf2-4831-b693-6eef5001a6b6 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:52.225297 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d736a57e-5cf2-4831-b693-6eef5001a6b6 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:52.225710 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d736a57e-5cf2-4831-b693-6eef5001a6b6 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:52.426277 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-a1b157c6-1e18-48b8-9121-bec7c3632222 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:52.426887 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-a1b157c6-1e18-48b8-9121-bec7c3632222 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:52.433368 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a1b157c6-1e18-48b8-9121-bec7c3632222 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:52.433840 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a1b157c6-1e18-48b8-9121-bec7c3632222 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:52.434294 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a1b157c6-1e18-48b8-9121-bec7c3632222 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:52.434967 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a1b157c6-1e18-48b8-9121-bec7c3632222 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:52.435394 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a1b157c6-1e18-48b8-9121-bec7c3632222 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:52.435815 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a1b157c6-1e18-48b8-9121-bec7c3632222 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:52.587551 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-a1b157c6-1e18-48b8-9121-bec7c3632222 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:52.596971 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-a1b157c6-1e18-48b8-9121-bec7c3632222 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9" status: 200 len: 1367 microversion: 2.1 time: 0.174517 Aug 12 01:28:52.597562 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 56/118] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:52 2022] GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:28:52.602349 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-2e39a0ad-0554-4c46-81e4-943aa098cd45 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:52.603277 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-2e39a0ad-0554-4c46-81e4-943aa098cd45 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:52.609424 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2e39a0ad-0554-4c46-81e4-943aa098cd45 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:52.610080 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2e39a0ad-0554-4c46-81e4-943aa098cd45 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:52.611574 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2e39a0ad-0554-4c46-81e4-943aa098cd45 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:52.612701 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2e39a0ad-0554-4c46-81e4-943aa098cd45 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:52.613195 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2e39a0ad-0554-4c46-81e4-943aa098cd45 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:52.613608 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2e39a0ad-0554-4c46-81e4-943aa098cd45 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:52.793581 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-2e39a0ad-0554-4c46-81e4-943aa098cd45 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:52.801465 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-2e39a0ad-0554-4c46-81e4-943aa098cd45 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1548 microversion: 2.1 time: 0.202703 Aug 12 01:28:52.802345 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 57/119] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:52 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1548 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:52.807584 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-c7c7ce33-be5d-45e8-98a0-9624280a8c7b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:52.808352 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-c7c7ce33-be5d-45e8-98a0-9624280a8c7b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:52.814174 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c7c7ce33-be5d-45e8-98a0-9624280a8c7b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:52.814786 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c7c7ce33-be5d-45e8-98a0-9624280a8c7b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:52.815338 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c7c7ce33-be5d-45e8-98a0-9624280a8c7b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:52.816214 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c7c7ce33-be5d-45e8-98a0-9624280a8c7b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:52.816824 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c7c7ce33-be5d-45e8-98a0-9624280a8c7b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:52.817448 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c7c7ce33-be5d-45e8-98a0-9624280a8c7b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:53.030889 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-c7c7ce33-be5d-45e8-98a0-9624280a8c7b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:53.041088 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-c7c7ce33-be5d-45e8-98a0-9624280a8c7b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:53.043986 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-c7c7ce33-be5d-45e8-98a0-9624280a8c7b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:53.045311 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-c7c7ce33-be5d-45e8-98a0-9624280a8c7b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1407 microversion: 2.20 time: 0.241912 Aug 12 01:28:53.045860 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 58/120] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:28:52 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:28:53.073166 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-51ba03c4-bb33-4e8f-b5a5-2e35ab14854c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:53.073960 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-51ba03c4-bb33-4e8f-b5a5-2e35ab14854c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:53.080302 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-51ba03c4-bb33-4e8f-b5a5-2e35ab14854c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:53.080804 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-51ba03c4-bb33-4e8f-b5a5-2e35ab14854c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:53.081277 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-51ba03c4-bb33-4e8f-b5a5-2e35ab14854c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:53.082057 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-51ba03c4-bb33-4e8f-b5a5-2e35ab14854c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:53.082886 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-51ba03c4-bb33-4e8f-b5a5-2e35ab14854c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:53.083448 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-51ba03c4-bb33-4e8f-b5a5-2e35ab14854c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:53.178979 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-51ba03c4-bb33-4e8f-b5a5-2e35ab14854c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109388 Aug 12 01:28:53.180587 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 59/121] 10.222.0.20 () {58 vars in 1275 bytes} [Fri Aug 12 01:28:53 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a/os-interface => generated 285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:28:53.189848 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-e4f1af46-0a68-4dd3-9255-449e877c385f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:53.190956 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-e4f1af46-0a68-4dd3-9255-449e877c385f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:53.201406 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e4f1af46-0a68-4dd3-9255-449e877c385f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:53.202208 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e4f1af46-0a68-4dd3-9255-449e877c385f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:53.203424 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e4f1af46-0a68-4dd3-9255-449e877c385f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:53.204208 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e4f1af46-0a68-4dd3-9255-449e877c385f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:53.205012 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e4f1af46-0a68-4dd3-9255-449e877c385f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:53.205766 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e4f1af46-0a68-4dd3-9255-449e877c385f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:53.369491 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-e4f1af46-0a68-4dd3-9255-449e877c385f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:53.377542 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-e4f1af46-0a68-4dd3-9255-449e877c385f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.195546 Aug 12 01:28:53.378081 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 60/122] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:53 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:53.618172 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-85bcecf3-b156-4633-bb28-5349f9c34058 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:53.618788 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-85bcecf3-b156-4633-bb28-5349f9c34058 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:53.624971 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-85bcecf3-b156-4633-bb28-5349f9c34058 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:53.625719 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-85bcecf3-b156-4633-bb28-5349f9c34058 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:53.626337 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-85bcecf3-b156-4633-bb28-5349f9c34058 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:53.627836 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-85bcecf3-b156-4633-bb28-5349f9c34058 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:53.628450 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-85bcecf3-b156-4633-bb28-5349f9c34058 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:53.629172 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-85bcecf3-b156-4633-bb28-5349f9c34058 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:53.732133 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-d736a57e-5cf2-4831-b693-6eef5001a6b6 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] 10.222.0.20 "POST /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.521230 Aug 12 01:28:53.733864 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 63/123] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Aug 12 01:28:52 2022] POST /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851/os-volume_attachments => generated 194 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:28:53.875065 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-85bcecf3-b156-4633-bb28-5349f9c34058 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:53.904488 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-85bcecf3-b156-4633-bb28-5349f9c34058 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9" status: 200 len: 1558 microversion: 2.1 time: 0.289547 Aug 12 01:28:53.908438 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 61/124] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:53 2022] GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 => generated 1558 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:28:53.931441 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-56a5007c-11b7-4e2b-974e-4e18c8118d51 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:53.932879 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-56a5007c-11b7-4e2b-974e-4e18c8118d51 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:53.945020 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-56a5007c-11b7-4e2b-974e-4e18c8118d51 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:53.945721 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-56a5007c-11b7-4e2b-974e-4e18c8118d51 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:53.946416 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-56a5007c-11b7-4e2b-974e-4e18c8118d51 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:53.947570 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-56a5007c-11b7-4e2b-974e-4e18c8118d51 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:53.948167 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-56a5007c-11b7-4e2b-974e-4e18c8118d51 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:53.948826 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-56a5007c-11b7-4e2b-974e-4e18c8118d51 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:54.076101 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-bdcaa520-c6ef-4b6c-b834-4738cd9d36ba tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:54.076729 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-bdcaa520-c6ef-4b6c-b834-4738cd9d36ba tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:54.084723 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bdcaa520-c6ef-4b6c-b834-4738cd9d36ba tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:54.088523 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bdcaa520-c6ef-4b6c-b834-4738cd9d36ba tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:54.089725 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bdcaa520-c6ef-4b6c-b834-4738cd9d36ba tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:54.090553 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bdcaa520-c6ef-4b6c-b834-4738cd9d36ba tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:54.091041 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bdcaa520-c6ef-4b6c-b834-4738cd9d36ba tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:54.095303 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bdcaa520-c6ef-4b6c-b834-4738cd9d36ba tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:54.152009 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-56a5007c-11b7-4e2b-974e-4e18c8118d51 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.218595 Aug 12 01:28:54.155419 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 64/125] 10.222.0.20 () {58 vars in 1275 bytes} [Fri Aug 12 01:28:53 2022] GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9/os-interface => generated 285 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:28:54.401948 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-2fb4398b-e418-40b3-b8cf-13118244cfca tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:54.402564 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-2fb4398b-e418-40b3-b8cf-13118244cfca tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:54.419299 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2fb4398b-e418-40b3-b8cf-13118244cfca tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:54.419815 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2fb4398b-e418-40b3-b8cf-13118244cfca tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:54.420242 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2fb4398b-e418-40b3-b8cf-13118244cfca tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:54.420957 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2fb4398b-e418-40b3-b8cf-13118244cfca tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:54.421394 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2fb4398b-e418-40b3-b8cf-13118244cfca tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:54.421812 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2fb4398b-e418-40b3-b8cf-13118244cfca tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:54.661938 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-bdcaa520-c6ef-4b6c-b834-4738cd9d36ba tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:54.670712 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-bdcaa520-c6ef-4b6c-b834-4738cd9d36ba tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:54.672588 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-bdcaa520-c6ef-4b6c-b834-4738cd9d36ba tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:54.674300 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-bdcaa520-c6ef-4b6c-b834-4738cd9d36ba tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1600 microversion: 2.20 time: 0.602304 Aug 12 01:28:54.675456 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 62/126] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:28:54 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1600 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:28:54.700349 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-e77ca077-2af8-4257-aba7-549cdb351d94 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:54.703564 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-e77ca077-2af8-4257-aba7-549cdb351d94 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:54.711435 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e77ca077-2af8-4257-aba7-549cdb351d94 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:54.712450 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e77ca077-2af8-4257-aba7-549cdb351d94 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:54.713036 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e77ca077-2af8-4257-aba7-549cdb351d94 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:54.714052 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e77ca077-2af8-4257-aba7-549cdb351d94 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:54.714796 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e77ca077-2af8-4257-aba7-549cdb351d94 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:54.715706 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e77ca077-2af8-4257-aba7-549cdb351d94 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:54.895949 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-2fb4398b-e418-40b3-b8cf-13118244cfca tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:54.903723 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-2fb4398b-e418-40b3-b8cf-13118244cfca tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.508222 Aug 12 01:28:54.904588 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 65/127] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:54 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:55.274932 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-e77ca077-2af8-4257-aba7-549cdb351d94 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.579422 Aug 12 01:28:55.275596 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 63/128] 10.222.0.20 () {60 vars in 1316 bytes} [Fri Aug 12 01:28:54 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8/os-interface => generated 285 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 12 01:28:55.608505 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-0f60c096-583b-4605-85e5-70ae2f7687f9 req-8547bf7d-f30f-4ddb-b108-676cfd6f17e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4364ac0-a9b7-4650-8456-15ccdd39bc3a", "tag": "4e439648-a2fe-49f9-a809-a2ad4090be7d"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:28:55.622074 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-0f60c096-583b-4605-85e5-70ae2f7687f9 req-8547bf7d-f30f-4ddb-b108-676cfd6f17e7 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:55.622902 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-0f60c096-583b-4605-85e5-70ae2f7687f9 req-8547bf7d-f30f-4ddb-b108-676cfd6f17e7 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:55.623567 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-0f60c096-583b-4605-85e5-70ae2f7687f9 req-8547bf7d-f30f-4ddb-b108-676cfd6f17e7 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:55.643840 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-0f60c096-583b-4605-85e5-70ae2f7687f9 req-8547bf7d-f30f-4ddb-b108-676cfd6f17e7 service nova] Creating event network-changed:4e439648-a2fe-49f9-a809-a2ad4090be7d for instance c4364ac0-a9b7-4650-8456-15ccdd39bc3a on hv-cinder-78481 Aug 12 01:28:55.650514 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-0f60c096-583b-4605-85e5-70ae2f7687f9 req-8547bf7d-f30f-4ddb-b108-676cfd6f17e7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046699 Aug 12 01:28:55.652378 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 66/129] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:28:55.926764 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-1e85466b-0c36-4acb-a93b-3a907a457d4f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:55.927994 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-1e85466b-0c36-4acb-a93b-3a907a457d4f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:55.935608 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1e85466b-0c36-4acb-a93b-3a907a457d4f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:55.942195 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1e85466b-0c36-4acb-a93b-3a907a457d4f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:55.942680 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1e85466b-0c36-4acb-a93b-3a907a457d4f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:55.945459 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1e85466b-0c36-4acb-a93b-3a907a457d4f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:55.947383 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1e85466b-0c36-4acb-a93b-3a907a457d4f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:55.948812 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1e85466b-0c36-4acb-a93b-3a907a457d4f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:56.360371 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-9819330e-aa15-44ca-841f-1286973f1802 req-af8c14b4-5b79-4e6d-a81e-b82de47c2b46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da106e4a-1bc6-4e68-ac0c-1a2ca899daa9", "tag": "941dd4d7-4c16-4fb4-aa93-79972bef7581"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:28:56.389472 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-1e85466b-0c36-4acb-a93b-3a907a457d4f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:56.396031 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-9819330e-aa15-44ca-841f-1286973f1802 req-af8c14b4-5b79-4e6d-a81e-b82de47c2b46 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:56.396508 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-9819330e-aa15-44ca-841f-1286973f1802 req-af8c14b4-5b79-4e6d-a81e-b82de47c2b46 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:56.396937 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-9819330e-aa15-44ca-841f-1286973f1802 req-af8c14b4-5b79-4e6d-a81e-b82de47c2b46 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:56.408032 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-1e85466b-0c36-4acb-a93b-3a907a457d4f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.486248 Aug 12 01:28:56.420229 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 64/130] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:55 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:56.441284 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-9819330e-aa15-44ca-841f-1286973f1802 req-af8c14b4-5b79-4e6d-a81e-b82de47c2b46 service nova] Creating event network-changed:941dd4d7-4c16-4fb4-aa93-79972bef7581 for instance da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 on hv-cinder-78481 Aug 12 01:28:56.459568 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-9819330e-aa15-44ca-841f-1286973f1802 req-af8c14b4-5b79-4e6d-a81e-b82de47c2b46 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104358 Aug 12 01:28:56.460188 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 67/131] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 01:28:57.431361 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-8cb796f4-d76c-41b5-aeea-55d7a340a57a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:57.432029 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-8cb796f4-d76c-41b5-aeea-55d7a340a57a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:57.448457 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8cb796f4-d76c-41b5-aeea-55d7a340a57a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:57.448955 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8cb796f4-d76c-41b5-aeea-55d7a340a57a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:57.449388 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8cb796f4-d76c-41b5-aeea-55d7a340a57a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:57.450099 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8cb796f4-d76c-41b5-aeea-55d7a340a57a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:57.450546 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8cb796f4-d76c-41b5-aeea-55d7a340a57a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:57.451136 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8cb796f4-d76c-41b5-aeea-55d7a340a57a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:57.812970 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-8cb796f4-d76c-41b5-aeea-55d7a340a57a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:57.823308 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-8cb796f4-d76c-41b5-aeea-55d7a340a57a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.396722 Aug 12 01:28:57.824512 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 65/132] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:57 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:28:58.092791 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-29989ddf-4910-4a39-970a-72d4dcc51ae8 req-6fa0c81b-c5d0-4fa5-98c2-45781999bda0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ed5ced2-87ad-4d0f-860c-648bcca91ca8", "tag": "476d0433-5310-435b-93ea-c42ed83c3136"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:28:58.121496 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-29989ddf-4910-4a39-970a-72d4dcc51ae8 req-6fa0c81b-c5d0-4fa5-98c2-45781999bda0 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:58.122257 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-29989ddf-4910-4a39-970a-72d4dcc51ae8 req-6fa0c81b-c5d0-4fa5-98c2-45781999bda0 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:58.122691 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-29989ddf-4910-4a39-970a-72d4dcc51ae8 req-6fa0c81b-c5d0-4fa5-98c2-45781999bda0 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:58.164835 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-29989ddf-4910-4a39-970a-72d4dcc51ae8 req-6fa0c81b-c5d0-4fa5-98c2-45781999bda0 service nova] Creating event network-changed:476d0433-5310-435b-93ea-c42ed83c3136 for instance 0ed5ced2-87ad-4d0f-860c-648bcca91ca8 on hv-cinder-78481 Aug 12 01:28:58.178115 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-29989ddf-4910-4a39-970a-72d4dcc51ae8 req-6fa0c81b-c5d0-4fa5-98c2-45781999bda0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090015 Aug 12 01:28:58.179358 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 68/133] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:28:58.845079 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-4e47d042-7e66-4209-a5df-c3ca008e781d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:28:58.845677 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-4e47d042-7e66-4209-a5df-c3ca008e781d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:28:58.855432 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4e47d042-7e66-4209-a5df-c3ca008e781d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:58.855832 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4e47d042-7e66-4209-a5df-c3ca008e781d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:58.856266 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4e47d042-7e66-4209-a5df-c3ca008e781d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:58.857205 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4e47d042-7e66-4209-a5df-c3ca008e781d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:28:58.857759 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4e47d042-7e66-4209-a5df-c3ca008e781d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:28:58.858184 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4e47d042-7e66-4209-a5df-c3ca008e781d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:28:59.234917 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-4e47d042-7e66-4209-a5df-c3ca008e781d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:28:59.246133 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-4e47d042-7e66-4209-a5df-c3ca008e781d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.404584 Aug 12 01:28:59.246133 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 66/134] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:28:58 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:00.267355 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-5aeb7b48-1fb0-4b24-84c2-3c2b1cd047e3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:00.268071 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-5aeb7b48-1fb0-4b24-84c2-3c2b1cd047e3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:00.275130 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5aeb7b48-1fb0-4b24-84c2-3c2b1cd047e3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:00.276023 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5aeb7b48-1fb0-4b24-84c2-3c2b1cd047e3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:00.276637 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5aeb7b48-1fb0-4b24-84c2-3c2b1cd047e3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:00.277398 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5aeb7b48-1fb0-4b24-84c2-3c2b1cd047e3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:00.277837 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5aeb7b48-1fb0-4b24-84c2-3c2b1cd047e3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:00.278393 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5aeb7b48-1fb0-4b24-84c2-3c2b1cd047e3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:00.499200 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-5aeb7b48-1fb0-4b24-84c2-3c2b1cd047e3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:00.509260 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-5aeb7b48-1fb0-4b24-84c2-3c2b1cd047e3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.246587 Aug 12 01:29:00.510695 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 69/135] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:00 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:01.530577 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-e13d21c9-66b5-4464-8aeb-a26bf17383dd tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:01.531832 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-e13d21c9-66b5-4464-8aeb-a26bf17383dd tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:01.538891 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e13d21c9-66b5-4464-8aeb-a26bf17383dd tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:01.539377 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e13d21c9-66b5-4464-8aeb-a26bf17383dd tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:01.540064 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e13d21c9-66b5-4464-8aeb-a26bf17383dd tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:01.540946 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e13d21c9-66b5-4464-8aeb-a26bf17383dd tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:01.541481 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e13d21c9-66b5-4464-8aeb-a26bf17383dd tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:01.541897 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e13d21c9-66b5-4464-8aeb-a26bf17383dd tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:01.833710 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-e13d21c9-66b5-4464-8aeb-a26bf17383dd tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:01.842881 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-e13d21c9-66b5-4464-8aeb-a26bf17383dd tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.316231 Aug 12 01:29:01.843464 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 67/136] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:01 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:29:02.863740 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-0c178bd1-487c-4355-a5de-eabb93c19354 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:02.872085 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-0c178bd1-487c-4355-a5de-eabb93c19354 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:02.875113 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_api:SELECT=89 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:29:02.882036 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0c178bd1-487c-4355-a5de-eabb93c19354 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:02.882740 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0c178bd1-487c-4355-a5de-eabb93c19354 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:02.883656 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0c178bd1-487c-4355-a5de-eabb93c19354 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:02.884837 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0c178bd1-487c-4355-a5de-eabb93c19354 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:02.885295 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0c178bd1-487c-4355-a5de-eabb93c19354 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:02.885721 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0c178bd1-487c-4355-a5de-eabb93c19354 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:02.914063 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:29:03.094789 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-0c178bd1-487c-4355-a5de-eabb93c19354 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:03.107805 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-0c178bd1-487c-4355-a5de-eabb93c19354 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.247935 Aug 12 01:29:03.108646 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 70/137] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:02 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:04.132069 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-927d855b-be89-4348-be46-5df37718976c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:04.133321 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-927d855b-be89-4348-be46-5df37718976c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:04.140608 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-927d855b-be89-4348-be46-5df37718976c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:04.141092 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-927d855b-be89-4348-be46-5df37718976c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:04.141521 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-927d855b-be89-4348-be46-5df37718976c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:04.142241 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-927d855b-be89-4348-be46-5df37718976c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:04.142682 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-927d855b-be89-4348-be46-5df37718976c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:04.143089 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-927d855b-be89-4348-be46-5df37718976c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:04.748546 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-927d855b-be89-4348-be46-5df37718976c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:04.757692 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-927d855b-be89-4348-be46-5df37718976c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.631032 Aug 12 01:29:04.758268 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 68/138] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:04 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:05.789087 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-f9346efd-3089-4827-8f5c-4451e6c387e1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:05.789703 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-f9346efd-3089-4827-8f5c-4451e6c387e1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:05.801660 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f9346efd-3089-4827-8f5c-4451e6c387e1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:05.802142 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f9346efd-3089-4827-8f5c-4451e6c387e1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:05.802617 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f9346efd-3089-4827-8f5c-4451e6c387e1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:05.803974 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f9346efd-3089-4827-8f5c-4451e6c387e1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:05.804722 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f9346efd-3089-4827-8f5c-4451e6c387e1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:05.805284 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f9346efd-3089-4827-8f5c-4451e6c387e1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:05.857409 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-b402b623-bd21-4452-a4e9-f666aee83123 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:05.858520 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-b402b623-bd21-4452-a4e9-f666aee83123 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] [instance: 26be209b-84c3-49e2-a869-ea8c00f94851] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:05.866317 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b402b623-bd21-4452-a4e9-f666aee83123 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:05.867084 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b402b623-bd21-4452-a4e9-f666aee83123 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:05.867746 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b402b623-bd21-4452-a4e9-f666aee83123 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:05.868648 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b402b623-bd21-4452-a4e9-f666aee83123 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:05.873699 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b402b623-bd21-4452-a4e9-f666aee83123 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:05.874439 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b402b623-bd21-4452-a4e9-f666aee83123 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:05.901920 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-b402b623-bd21-4452-a4e9-f666aee83123 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] [instance: 26be209b-84c3-49e2-a869-ea8c00f94851] Going to try to terminate instance {{(pid=120785) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 01:29:05.905228 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell1:SELECT=100 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:29:06.025341 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-b402b623-bd21-4452-a4e9-f666aee83123 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] 10.222.0.20 "DELETE /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851" status: 204 len: 0 microversion: 2.1 time: 0.171606 Aug 12 01:29:06.026191 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 69/139] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 01:29:05 2022] DELETE /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 01:29:06.035107 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-324b5755-14aa-480a-ad6d-3b1305cb691b tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:06.035815 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-324b5755-14aa-480a-ad6d-3b1305cb691b tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] [instance: 26be209b-84c3-49e2-a869-ea8c00f94851] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:06.042246 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-324b5755-14aa-480a-ad6d-3b1305cb691b tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:06.042959 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-324b5755-14aa-480a-ad6d-3b1305cb691b tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:06.043961 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-324b5755-14aa-480a-ad6d-3b1305cb691b tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:06.045008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-324b5755-14aa-480a-ad6d-3b1305cb691b tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:06.045992 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-324b5755-14aa-480a-ad6d-3b1305cb691b tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:06.046573 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-324b5755-14aa-480a-ad6d-3b1305cb691b tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:06.077796 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-f9346efd-3089-4827-8f5c-4451e6c387e1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:06.091609 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-f9346efd-3089-4827-8f5c-4451e6c387e1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.315172 Aug 12 01:29:06.092871 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 71/140] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:05 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:06.276327 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-324b5755-14aa-480a-ad6d-3b1305cb691b tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023a04369b394bd1b035ab793e0b93b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf0858834c84aaa993de55f361d6ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:06.289503 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-324b5755-14aa-480a-ad6d-3b1305cb691b tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] 10.222.0.20 "GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851" status: 200 len: 1553 microversion: 2.1 time: 0.258413 Aug 12 01:29:06.290969 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 70/141] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:06 2022] GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851 => generated 1553 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:29:07.113755 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-74f1a376-b0c9-4eba-82e3-96ec68774bc3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:07.114529 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-74f1a376-b0c9-4eba-82e3-96ec68774bc3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:07.129144 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-74f1a376-b0c9-4eba-82e3-96ec68774bc3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:07.129812 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-74f1a376-b0c9-4eba-82e3-96ec68774bc3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:07.130239 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-74f1a376-b0c9-4eba-82e3-96ec68774bc3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:07.131288 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-74f1a376-b0c9-4eba-82e3-96ec68774bc3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:07.132078 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-74f1a376-b0c9-4eba-82e3-96ec68774bc3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:07.132797 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-74f1a376-b0c9-4eba-82e3-96ec68774bc3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:07.312147 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-afc654e5-96cd-4162-87e8-1fc4c0814cdf tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:07.313492 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-afc654e5-96cd-4162-87e8-1fc4c0814cdf tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] [instance: 26be209b-84c3-49e2-a869-ea8c00f94851] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:07.320030 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:29:07.323167 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-afc654e5-96cd-4162-87e8-1fc4c0814cdf tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:07.324183 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-afc654e5-96cd-4162-87e8-1fc4c0814cdf tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:07.324754 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-afc654e5-96cd-4162-87e8-1fc4c0814cdf tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:07.325585 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-afc654e5-96cd-4162-87e8-1fc4c0814cdf tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:07.326194 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-afc654e5-96cd-4162-87e8-1fc4c0814cdf tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:07.327070 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-afc654e5-96cd-4162-87e8-1fc4c0814cdf tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:07.452772 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-74f1a376-b0c9-4eba-82e3-96ec68774bc3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:07.463146 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-74f1a376-b0c9-4eba-82e3-96ec68774bc3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.353163 Aug 12 01:29:07.467017 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 72/142] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:07 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:07.618261 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-afc654e5-96cd-4162-87e8-1fc4c0814cdf tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023a04369b394bd1b035ab793e0b93b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf0858834c84aaa993de55f361d6ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:07.626896 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-afc654e5-96cd-4162-87e8-1fc4c0814cdf tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] 10.222.0.20 "GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851" status: 200 len: 1553 microversion: 2.1 time: 0.319366 Aug 12 01:29:07.627721 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 71/143] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:07 2022] GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851 => generated 1553 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:08.487610 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-ca61f38c-77ee-4929-b5ab-603f4c20cd5a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:08.489068 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-ca61f38c-77ee-4929-b5ab-603f4c20cd5a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:08.500121 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ca61f38c-77ee-4929-b5ab-603f4c20cd5a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:08.501079 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ca61f38c-77ee-4929-b5ab-603f4c20cd5a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:08.502993 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ca61f38c-77ee-4929-b5ab-603f4c20cd5a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:08.526699 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ca61f38c-77ee-4929-b5ab-603f4c20cd5a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:08.527721 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ca61f38c-77ee-4929-b5ab-603f4c20cd5a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:08.528377 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ca61f38c-77ee-4929-b5ab-603f4c20cd5a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:08.655989 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-e0305498-3ec1-4f2d-bb21-12cce467bd98 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:08.657287 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-e0305498-3ec1-4f2d-bb21-12cce467bd98 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] [instance: 26be209b-84c3-49e2-a869-ea8c00f94851] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:08.664935 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e0305498-3ec1-4f2d-bb21-12cce467bd98 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:08.665687 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e0305498-3ec1-4f2d-bb21-12cce467bd98 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:08.666914 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e0305498-3ec1-4f2d-bb21-12cce467bd98 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:08.668046 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e0305498-3ec1-4f2d-bb21-12cce467bd98 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:08.668836 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e0305498-3ec1-4f2d-bb21-12cce467bd98 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:08.669410 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e0305498-3ec1-4f2d-bb21-12cce467bd98 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:08.965798 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-ca61f38c-77ee-4929-b5ab-603f4c20cd5a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:08.972323 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-e0305498-3ec1-4f2d-bb21-12cce467bd98 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023a04369b394bd1b035ab793e0b93b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf0858834c84aaa993de55f361d6ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:08.975892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-ca61f38c-77ee-4929-b5ab-603f4c20cd5a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.493869 Aug 12 01:29:08.984335 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-e0305498-3ec1-4f2d-bb21-12cce467bd98 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] 10.222.0.20 "GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851" status: 200 len: 1553 microversion: 2.1 time: 0.338747 Aug 12 01:29:08.985341 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 72/144] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:08 2022] GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851 => generated 1553 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:29:08.993951 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 73/145] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:08 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:10.000192 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-13a41978-128f-41ff-99b4-613d97cc0dc2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:10.001535 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-13a41978-128f-41ff-99b4-613d97cc0dc2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:10.010026 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-13a41978-128f-41ff-99b4-613d97cc0dc2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:10.010589 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-13a41978-128f-41ff-99b4-613d97cc0dc2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:10.010977 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-13a41978-128f-41ff-99b4-613d97cc0dc2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:10.012262 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-e6e66fcc-5765-47fb-97cb-572d12970d9a tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:10.013072 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-e6e66fcc-5765-47fb-97cb-572d12970d9a tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] [instance: 26be209b-84c3-49e2-a869-ea8c00f94851] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:10.025706 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e6e66fcc-5765-47fb-97cb-572d12970d9a tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:10.026636 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e6e66fcc-5765-47fb-97cb-572d12970d9a tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:10.027765 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e6e66fcc-5765-47fb-97cb-572d12970d9a tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:10.029246 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e6e66fcc-5765-47fb-97cb-572d12970d9a tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:10.030225 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-13a41978-128f-41ff-99b4-613d97cc0dc2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:10.030855 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-13a41978-128f-41ff-99b4-613d97cc0dc2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:10.031351 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e6e66fcc-5765-47fb-97cb-572d12970d9a tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:10.031637 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-13a41978-128f-41ff-99b4-613d97cc0dc2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:10.032260 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e6e66fcc-5765-47fb-97cb-572d12970d9a tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:10.474902 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-13a41978-128f-41ff-99b4-613d97cc0dc2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:10.484316 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-13a41978-128f-41ff-99b4-613d97cc0dc2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.488028 Aug 12 01:29:10.484897 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 73/146] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:09 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:10.489810 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-e6e66fcc-5765-47fb-97cb-572d12970d9a tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023a04369b394bd1b035ab793e0b93b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf0858834c84aaa993de55f361d6ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:10.501738 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-e6e66fcc-5765-47fb-97cb-572d12970d9a tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] 10.222.0.20 "GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851" status: 200 len: 1553 microversion: 2.1 time: 0.495645 Aug 12 01:29:10.502833 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 74/147] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:10 2022] GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851 => generated 1553 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:29:11.506715 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-6402ab8b-437b-41d6-914b-573cca10418c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:11.507520 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-6402ab8b-437b-41d6-914b-573cca10418c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:11.516310 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6402ab8b-437b-41d6-914b-573cca10418c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:11.516928 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6402ab8b-437b-41d6-914b-573cca10418c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:11.517455 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6402ab8b-437b-41d6-914b-573cca10418c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:11.518254 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6402ab8b-437b-41d6-914b-573cca10418c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:11.518800 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6402ab8b-437b-41d6-914b-573cca10418c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:11.519742 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6402ab8b-437b-41d6-914b-573cca10418c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:11.524161 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-c21ae27d-2561-4f5b-ab4b-0ff551ab5274 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:11.524883 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-c21ae27d-2561-4f5b-ab4b-0ff551ab5274 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] [instance: 26be209b-84c3-49e2-a869-ea8c00f94851] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:11.534432 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c21ae27d-2561-4f5b-ab4b-0ff551ab5274 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:11.534911 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c21ae27d-2561-4f5b-ab4b-0ff551ab5274 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:11.535389 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c21ae27d-2561-4f5b-ab4b-0ff551ab5274 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:11.536126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c21ae27d-2561-4f5b-ab4b-0ff551ab5274 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:11.536566 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c21ae27d-2561-4f5b-ab4b-0ff551ab5274 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:11.536977 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c21ae27d-2561-4f5b-ab4b-0ff551ab5274 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:11.788416 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-6402ab8b-437b-41d6-914b-573cca10418c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:11.793658 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-c21ae27d-2561-4f5b-ab4b-0ff551ab5274 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023a04369b394bd1b035ab793e0b93b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf0858834c84aaa993de55f361d6ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:11.809440 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-6402ab8b-437b-41d6-914b-573cca10418c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.306492 Aug 12 01:29:11.810872 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-c21ae27d-2561-4f5b-ab4b-0ff551ab5274 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] 10.222.0.20 "GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851" status: 200 len: 1553 microversion: 2.1 time: 0.291715 Aug 12 01:29:11.812015 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 74/148] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:11 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:11.824200 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 75/149] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:11 2022] GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851 => generated 1553 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:29:12.834243 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-f7e01fd9-dc93-43eb-ae6b-b8b3287b48b2 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:12.834877 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-f7e01fd9-dc93-43eb-ae6b-b8b3287b48b2 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] [instance: 26be209b-84c3-49e2-a869-ea8c00f94851] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:12.840647 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-1143bd4a-79a4-41d4-9c61-54cbb0810af5 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:12.841257 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-1143bd4a-79a4-41d4-9c61-54cbb0810af5 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:12.850183 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f7e01fd9-dc93-43eb-ae6b-b8b3287b48b2 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:12.850686 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f7e01fd9-dc93-43eb-ae6b-b8b3287b48b2 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:12.851143 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f7e01fd9-dc93-43eb-ae6b-b8b3287b48b2 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:12.851864 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f7e01fd9-dc93-43eb-ae6b-b8b3287b48b2 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:12.852314 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f7e01fd9-dc93-43eb-ae6b-b8b3287b48b2 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:12.852745 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f7e01fd9-dc93-43eb-ae6b-b8b3287b48b2 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:12.859588 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1143bd4a-79a4-41d4-9c61-54cbb0810af5 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:12.860090 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1143bd4a-79a4-41d4-9c61-54cbb0810af5 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:12.860525 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1143bd4a-79a4-41d4-9c61-54cbb0810af5 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:12.861230 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1143bd4a-79a4-41d4-9c61-54cbb0810af5 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:12.861681 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1143bd4a-79a4-41d4-9c61-54cbb0810af5 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:12.862108 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1143bd4a-79a4-41d4-9c61-54cbb0810af5 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:13.141108 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-1143bd4a-79a4-41d4-9c61-54cbb0810af5 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:13.152219 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-1143bd4a-79a4-41d4-9c61-54cbb0810af5 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.315414 Aug 12 01:29:13.153008 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 76/150] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:12 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:13.165844 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-f7e01fd9-dc93-43eb-ae6b-b8b3287b48b2 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023a04369b394bd1b035ab793e0b93b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf0858834c84aaa993de55f361d6ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:13.179102 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-f7e01fd9-dc93-43eb-ae6b-b8b3287b48b2 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] 10.222.0.20 "GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851" status: 200 len: 1553 microversion: 2.1 time: 0.348848 Aug 12 01:29:13.188494 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 75/151] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:12 2022] GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851 => generated 1553 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:14.173622 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-8c26448f-1f04-4fb1-8eda-ae24f89635dc tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:14.174232 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-8c26448f-1f04-4fb1-8eda-ae24f89635dc tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:14.181423 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8c26448f-1f04-4fb1-8eda-ae24f89635dc tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:14.182110 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8c26448f-1f04-4fb1-8eda-ae24f89635dc tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:14.182711 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8c26448f-1f04-4fb1-8eda-ae24f89635dc tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:14.183779 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8c26448f-1f04-4fb1-8eda-ae24f89635dc tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:14.184382 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8c26448f-1f04-4fb1-8eda-ae24f89635dc tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:14.184947 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8c26448f-1f04-4fb1-8eda-ae24f89635dc tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:14.204644 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-89792892-7818-4afd-adf0-e9df44a854c4 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:14.206527 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-89792892-7818-4afd-adf0-e9df44a854c4 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] [instance: 26be209b-84c3-49e2-a869-ea8c00f94851] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:14.223279 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-89792892-7818-4afd-adf0-e9df44a854c4 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:14.224225 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-89792892-7818-4afd-adf0-e9df44a854c4 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:14.225130 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-89792892-7818-4afd-adf0-e9df44a854c4 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:14.227638 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-89792892-7818-4afd-adf0-e9df44a854c4 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:14.228312 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-89792892-7818-4afd-adf0-e9df44a854c4 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:14.230544 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-89792892-7818-4afd-adf0-e9df44a854c4 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:14.712460 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-8c26448f-1f04-4fb1-8eda-ae24f89635dc tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:14.728538 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-8c26448f-1f04-4fb1-8eda-ae24f89635dc tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.558557 Aug 12 01:29:14.729168 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 77/152] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:14 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:14.783348 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-89792892-7818-4afd-adf0-e9df44a854c4 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023a04369b394bd1b035ab793e0b93b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf0858834c84aaa993de55f361d6ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:14.792762 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-89792892-7818-4afd-adf0-e9df44a854c4 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] 10.222.0.20 "GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851" status: 200 len: 1553 microversion: 2.1 time: 0.594828 Aug 12 01:29:14.796916 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 76/153] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:14 2022] GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851 => generated 1553 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:29:15.286593 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-c203fe8a-27fc-43ad-9ead-f0a3ce9ec35a req-37d9cf15-4c4e-478e-b075-e7a7f1c71272 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26be209b-84c3-49e2-a869-ea8c00f94851", "name": "network-vif-deleted", "tag": "e88a4d4f-78ca-43d6-9412-606c68ca8ff1"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:29:15.318831 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-c203fe8a-27fc-43ad-9ead-f0a3ce9ec35a req-37d9cf15-4c4e-478e-b075-e7a7f1c71272 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:15.319689 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-c203fe8a-27fc-43ad-9ead-f0a3ce9ec35a req-37d9cf15-4c4e-478e-b075-e7a7f1c71272 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:15.320695 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-c203fe8a-27fc-43ad-9ead-f0a3ce9ec35a req-37d9cf15-4c4e-478e-b075-e7a7f1c71272 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:15.355395 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-c203fe8a-27fc-43ad-9ead-f0a3ce9ec35a req-37d9cf15-4c4e-478e-b075-e7a7f1c71272 service nova] Creating event network-vif-deleted:e88a4d4f-78ca-43d6-9412-606c68ca8ff1 for instance 26be209b-84c3-49e2-a869-ea8c00f94851 on hv-cinder-78481 Aug 12 01:29:15.373364 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-c203fe8a-27fc-43ad-9ead-f0a3ce9ec35a req-37d9cf15-4c4e-478e-b075-e7a7f1c71272 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091259 Aug 12 01:29:15.374510 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 78/154] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:29:15.750468 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-e6abf735-5386-4ec7-a6b3-a3f5e468c7db tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:15.751755 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-e6abf735-5386-4ec7-a6b3-a3f5e468c7db tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:15.758324 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e6abf735-5386-4ec7-a6b3-a3f5e468c7db tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:15.759013 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e6abf735-5386-4ec7-a6b3-a3f5e468c7db tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:15.759672 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e6abf735-5386-4ec7-a6b3-a3f5e468c7db tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:15.760520 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e6abf735-5386-4ec7-a6b3-a3f5e468c7db tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:15.761109 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e6abf735-5386-4ec7-a6b3-a3f5e468c7db tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:15.761682 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e6abf735-5386-4ec7-a6b3-a3f5e468c7db tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:15.822431 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-7677c8a5-74a6-4810-8bbd-fc6548182502 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:15.823376 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-7677c8a5-74a6-4810-8bbd-fc6548182502 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] [instance: 26be209b-84c3-49e2-a869-ea8c00f94851] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:15.835632 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7677c8a5-74a6-4810-8bbd-fc6548182502 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:15.840331 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7677c8a5-74a6-4810-8bbd-fc6548182502 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:15.842166 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7677c8a5-74a6-4810-8bbd-fc6548182502 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:15.845063 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7677c8a5-74a6-4810-8bbd-fc6548182502 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:15.847638 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7677c8a5-74a6-4810-8bbd-fc6548182502 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:15.848233 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7677c8a5-74a6-4810-8bbd-fc6548182502 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:15.963896 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-7677c8a5-74a6-4810-8bbd-fc6548182502 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023a04369b394bd1b035ab793e0b93b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf0858834c84aaa993de55f361d6ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:15.974056 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-7677c8a5-74a6-4810-8bbd-fc6548182502 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] 10.222.0.20 "GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851" status: 200 len: 1346 microversion: 2.1 time: 0.156825 Aug 12 01:29:15.975214 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 79/155] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:15 2022] GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851 => generated 1346 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:16.019474 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-e6abf735-5386-4ec7-a6b3-a3f5e468c7db tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:16.029092 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-e6abf735-5386-4ec7-a6b3-a3f5e468c7db tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.282082 Aug 12 01:29:16.030963 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 77/156] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:15 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:16.999959 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-c4158055-50e9-4ef4-a3e5-06e7f9b48f9f tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:17.003891 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-c4158055-50e9-4ef4-a3e5-06e7f9b48f9f tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] [instance: 26be209b-84c3-49e2-a869-ea8c00f94851] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:17.027903 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c4158055-50e9-4ef4-a3e5-06e7f9b48f9f tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:17.029669 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c4158055-50e9-4ef4-a3e5-06e7f9b48f9f tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:17.031175 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c4158055-50e9-4ef4-a3e5-06e7f9b48f9f tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:17.033431 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c4158055-50e9-4ef4-a3e5-06e7f9b48f9f tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:17.033836 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c4158055-50e9-4ef4-a3e5-06e7f9b48f9f tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:17.034264 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c4158055-50e9-4ef4-a3e5-06e7f9b48f9f tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:17.051028 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-12f577d7-2fed-4be2-9b7d-061f8919ccab tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:17.051659 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-12f577d7-2fed-4be2-9b7d-061f8919ccab tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:17.059629 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-12f577d7-2fed-4be2-9b7d-061f8919ccab tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:17.060439 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-12f577d7-2fed-4be2-9b7d-061f8919ccab tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:17.061140 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-12f577d7-2fed-4be2-9b7d-061f8919ccab tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:17.062143 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-12f577d7-2fed-4be2-9b7d-061f8919ccab tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:17.063231 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-12f577d7-2fed-4be2-9b7d-061f8919ccab tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:17.063630 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.wsgi [None req-c4158055-50e9-4ef4-a3e5-06e7f9b48f9f tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] HTTP exception thrown: Instance 26be209b-84c3-49e2-a869-ea8c00f94851 could not be found. Aug 12 01:29:17.064392 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-12f577d7-2fed-4be2-9b7d-061f8919ccab tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:17.070207 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-c4158055-50e9-4ef4-a3e5-06e7f9b48f9f tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Request method failure captured: Aug 12 01:29:17.070207 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: request: GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851 HTTP/1.1 Aug 12 01:29:17.070207 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept: application/json Aug 12 01:29:17.070207 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept-Encoding: identity Aug 12 01:29:17.070207 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Connection: close Aug 12 01:29:17.070207 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Length: 0 Aug 12 01:29:17.070207 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Type: application/json Aug 12 01:29:17.070207 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Host: 10.222.0.20 Aug 12 01:29:17.070207 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Openstack-System-Scope: None Aug 12 01:29:17.070207 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: User-Agent: python-urllib3/1.26.11 Aug 12 01:29:17.070207 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Auth-Token: gAAAAABi9ayuN0ih7Jq554kKIfYPN-Y27qiMAena8WRZBHLhCFXgc3Bu_lGw9PseumOaZZlyvAZJrc6Eptz20-VdpftNhfYcnqEuDbqD4nxZw0_LeXas1u1L9s6_SBFxozepwu24qKp2NLn4m2BlNcps2QN62Ffpijd4Tdwj7gwKkzfTFdmy_YE Aug 12 01:29:17.070207 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Id: None Aug 12 01:29:17.070207 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Name: None Aug 12 01:29:17.070207 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Identity-Status: Confirmed Aug 12 01:29:17.070207 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Is-Admin-Project: True Aug 12 01:29:17.070207 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Id: default Aug 12 01:29:17.070207 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Name: Default Aug 12 01:29:17.070207 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Id: 7cf0858834c84aaa993de55f361d6ed9 Aug 12 01:29:17.070207 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Name: tempest-DeleteServersTestJSON-1853341616 Aug 12 01:29:17.070207 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Role: member,reader Aug 12 01:29:17.070207 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Roles: member,reader Aug 12 01:29:17.072326 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7cf0858834c84aaa993de55f361d6ed9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7cf0858834c84aaa993de55f361d6ed9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7cf0858834c84aaa993de55f361d6ed9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7cf0858834c84aaa993de55f361d6ed9"}]}] Aug 12 01:29:17.072326 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant: tempest-DeleteServersTestJSON-1853341616 Aug 12 01:29:17.072326 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Id: 7cf0858834c84aaa993de55f361d6ed9 Aug 12 01:29:17.072326 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Name: tempest-DeleteServersTestJSON-1853341616 Aug 12 01:29:17.072326 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User: tempest-DeleteServersTestJSON-1853341616-project Aug 12 01:29:17.072326 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Id: default Aug 12 01:29:17.072326 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Name: Default Aug 12 01:29:17.072326 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Id: 023a04369b394bd1b035ab793e0b93b0 Aug 12 01:29:17.072326 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Name: tempest-DeleteServersTestJSON-1853341616-project Aug 12 01:29:17.072326 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: method: > Aug 12 01:29:17.072326 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: exception: Instance 26be209b-84c3-49e2-a869-ea8c00f94851 could not be found. Aug 12 01:29:17.072326 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: action_args: {'id': '26be209b-84c3-49e2-a869-ea8c00f94851'} Aug 12 01:29:17.073471 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:29:17.073471 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:29:17.073471 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:29:17.073471 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:29:17.073471 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:29:17.073471 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:29:17.073471 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:29:17.073471 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:29:17.073471 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:29:17.073471 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:29:17.073471 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26be209b-84c3-49e2-a869-ea8c00f94851 could not be found. Aug 12 01:29:17.073471 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:29:17.073471 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:29:17.073471 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:29:17.073471 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:29:17.073471 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:29:17.073471 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:29:17.073471 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:29:17.073471 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:29:17.073471 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:29:17.074841 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:29:17.074841 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 01:29:17.074841 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 01:29:17.074841 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:29:17.074841 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:29:17.074841 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:29:17.074841 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:29:17.074841 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26be209b-84c3-49e2-a869-ea8c00f94851 could not be found. Aug 12 01:29:17.074841 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:29:17.074841 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:29:17.074841 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:29:17.074841 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:29:17.074841 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:29:17.074841 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:29:17.074841 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:29:17.074841 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:29:17.074841 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26be209b-84c3-49e2-a869-ea8c00f94851 could not be found. Aug 12 01:29:17.074841 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:29:17.077130 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-c4158055-50e9-4ef4-a3e5-06e7f9b48f9f tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Returning 404 to user: Instance 26be209b-84c3-49e2-a869-ea8c00f94851 could not be found. {{(pid=120786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:29:17.077130 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-c4158055-50e9-4ef4-a3e5-06e7f9b48f9f tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] 10.222.0.20 "GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851" status: 404 len: 111 microversion: 2.1 time: 0.077146 Aug 12 01:29:17.077130 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 80/157] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:16 2022] GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:29:17.227639 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-928c1442-ea07-4adc-bf8b-0de890f0dc60 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:17.230120 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-928c1442-ea07-4adc-bf8b-0de890f0dc60 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] [instance: 26be209b-84c3-49e2-a869-ea8c00f94851] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:17.236800 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-928c1442-ea07-4adc-bf8b-0de890f0dc60 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:17.237293 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-928c1442-ea07-4adc-bf8b-0de890f0dc60 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:17.237718 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-928c1442-ea07-4adc-bf8b-0de890f0dc60 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:17.238545 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-928c1442-ea07-4adc-bf8b-0de890f0dc60 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:17.242641 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-928c1442-ea07-4adc-bf8b-0de890f0dc60 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:17.243187 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-928c1442-ea07-4adc-bf8b-0de890f0dc60 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:17.257786 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.wsgi [None req-928c1442-ea07-4adc-bf8b-0de890f0dc60 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] HTTP exception thrown: Instance 26be209b-84c3-49e2-a869-ea8c00f94851 could not be found. Aug 12 01:29:17.259515 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-928c1442-ea07-4adc-bf8b-0de890f0dc60 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Request method failure captured: Aug 12 01:29:17.259515 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: request: GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851/os-volume_attachments HTTP/1.1 Aug 12 01:29:17.259515 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept: application/json Aug 12 01:29:17.259515 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept-Encoding: identity Aug 12 01:29:17.259515 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Connection: close Aug 12 01:29:17.259515 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Length: 0 Aug 12 01:29:17.259515 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Type: application/json Aug 12 01:29:17.259515 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Host: 10.222.0.20 Aug 12 01:29:17.259515 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Openstack-System-Scope: None Aug 12 01:29:17.259515 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: User-Agent: python-urllib3/1.26.11 Aug 12 01:29:17.259515 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Auth-Token: gAAAAABi9ayuN0ih7Jq554kKIfYPN-Y27qiMAena8WRZBHLhCFXgc3Bu_lGw9PseumOaZZlyvAZJrc6Eptz20-VdpftNhfYcnqEuDbqD4nxZw0_LeXas1u1L9s6_SBFxozepwu24qKp2NLn4m2BlNcps2QN62Ffpijd4Tdwj7gwKkzfTFdmy_YE Aug 12 01:29:17.259515 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Id: None Aug 12 01:29:17.259515 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Name: None Aug 12 01:29:17.259515 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Identity-Status: Confirmed Aug 12 01:29:17.259515 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Is-Admin-Project: True Aug 12 01:29:17.259515 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Id: default Aug 12 01:29:17.259515 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Name: Default Aug 12 01:29:17.259515 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Id: 7cf0858834c84aaa993de55f361d6ed9 Aug 12 01:29:17.259515 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Name: tempest-DeleteServersTestJSON-1853341616 Aug 12 01:29:17.259515 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Role: member,reader Aug 12 01:29:17.259515 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Roles: member,reader Aug 12 01:29:17.260982 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7cf0858834c84aaa993de55f361d6ed9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7cf0858834c84aaa993de55f361d6ed9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7cf0858834c84aaa993de55f361d6ed9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7cf0858834c84aaa993de55f361d6ed9"}]}] Aug 12 01:29:17.260982 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant: tempest-DeleteServersTestJSON-1853341616 Aug 12 01:29:17.260982 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Id: 7cf0858834c84aaa993de55f361d6ed9 Aug 12 01:29:17.260982 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Name: tempest-DeleteServersTestJSON-1853341616 Aug 12 01:29:17.260982 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User: tempest-DeleteServersTestJSON-1853341616-project Aug 12 01:29:17.260982 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Id: default Aug 12 01:29:17.260982 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Name: Default Aug 12 01:29:17.260982 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Id: 023a04369b394bd1b035ab793e0b93b0 Aug 12 01:29:17.260982 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Name: tempest-DeleteServersTestJSON-1853341616-project Aug 12 01:29:17.260982 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: method: > Aug 12 01:29:17.260982 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: exception: Instance 26be209b-84c3-49e2-a869-ea8c00f94851 could not be found. Aug 12 01:29:17.260982 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: action_args: {'server_id': '26be209b-84c3-49e2-a869-ea8c00f94851'} Aug 12 01:29:17.261788 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:29:17.261788 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:29:17.261788 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:29:17.261788 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:29:17.261788 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:29:17.261788 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:29:17.261788 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:29:17.261788 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:29:17.261788 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:29:17.261788 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:29:17.261788 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26be209b-84c3-49e2-a869-ea8c00f94851 could not be found. Aug 12 01:29:17.261788 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:29:17.261788 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:29:17.261788 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:29:17.261788 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:29:17.261788 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:29:17.261788 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:29:17.261788 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:29:17.261788 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:29:17.261788 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:29:17.263066 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:29:17.263066 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 12 01:29:17.263066 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 01:29:17.263066 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 12 01:29:17.263066 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 01:29:17.263066 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 12 01:29:17.263066 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 12 01:29:17.263066 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:29:17.263066 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:29:17.263066 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26be209b-84c3-49e2-a869-ea8c00f94851 could not be found. Aug 12 01:29:17.263066 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:29:17.263066 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:29:17.263066 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:29:17.263066 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:29:17.263066 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:29:17.263066 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:29:17.263066 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:29:17.263066 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:29:17.263066 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26be209b-84c3-49e2-a869-ea8c00f94851 could not be found. Aug 12 01:29:17.263066 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:29:17.264462 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-12f577d7-2fed-4be2-9b7d-061f8919ccab tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:17.265377 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-928c1442-ea07-4adc-bf8b-0de890f0dc60 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Returning 404 to user: Instance 26be209b-84c3-49e2-a869-ea8c00f94851 could not be found. {{(pid=120786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:29:17.266378 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-928c1442-ea07-4adc-bf8b-0de890f0dc60 tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] 10.222.0.20 "GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.043288 Aug 12 01:29:17.267578 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 81/158] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 01:29:17 2022] GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 12 01:29:17.272998 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-12f577d7-2fed-4be2-9b7d-061f8919ccab tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.226532 Aug 12 01:29:17.273930 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 78/159] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:17 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:18.295583 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-618ab280-14a4-4e1c-a0ce-7ede24f74fb6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:18.296859 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-618ab280-14a4-4e1c-a0ce-7ede24f74fb6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:18.304212 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-618ab280-14a4-4e1c-a0ce-7ede24f74fb6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:18.305003 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-618ab280-14a4-4e1c-a0ce-7ede24f74fb6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:18.305636 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-618ab280-14a4-4e1c-a0ce-7ede24f74fb6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:18.307322 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-618ab280-14a4-4e1c-a0ce-7ede24f74fb6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:18.308022 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-618ab280-14a4-4e1c-a0ce-7ede24f74fb6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:18.309132 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-618ab280-14a4-4e1c-a0ce-7ede24f74fb6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:18.469505 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-618ab280-14a4-4e1c-a0ce-7ede24f74fb6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:18.479658 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-618ab280-14a4-4e1c-a0ce-7ede24f74fb6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.188360 Aug 12 01:29:18.480693 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 82/160] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:18 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:18.669770 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-cd16b913-a19b-4f80-a42e-2a3da47edb1e tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:18.671089 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-cd16b913-a19b-4f80-a42e-2a3da47edb1e tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] [instance: 26be209b-84c3-49e2-a869-ea8c00f94851] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:18.681315 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cd16b913-a19b-4f80-a42e-2a3da47edb1e tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:18.682106 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cd16b913-a19b-4f80-a42e-2a3da47edb1e tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:18.682745 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cd16b913-a19b-4f80-a42e-2a3da47edb1e tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:18.683764 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cd16b913-a19b-4f80-a42e-2a3da47edb1e tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:18.684353 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cd16b913-a19b-4f80-a42e-2a3da47edb1e tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:18.685019 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cd16b913-a19b-4f80-a42e-2a3da47edb1e tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:18.699812 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.wsgi [None req-cd16b913-a19b-4f80-a42e-2a3da47edb1e tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] HTTP exception thrown: Instance 26be209b-84c3-49e2-a869-ea8c00f94851 could not be found. Aug 12 01:29:18.704981 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-cd16b913-a19b-4f80-a42e-2a3da47edb1e tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Request method failure captured: Aug 12 01:29:18.704981 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: request: DELETE /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851 HTTP/1.1 Aug 12 01:29:18.704981 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept: application/json Aug 12 01:29:18.704981 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept-Encoding: identity Aug 12 01:29:18.704981 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Connection: close Aug 12 01:29:18.704981 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Length: 0 Aug 12 01:29:18.704981 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Type: application/json Aug 12 01:29:18.704981 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Host: 10.222.0.20 Aug 12 01:29:18.704981 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Openstack-System-Scope: None Aug 12 01:29:18.704981 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: User-Agent: python-urllib3/1.26.11 Aug 12 01:29:18.704981 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Auth-Token: gAAAAABi9ayuN0ih7Jq554kKIfYPN-Y27qiMAena8WRZBHLhCFXgc3Bu_lGw9PseumOaZZlyvAZJrc6Eptz20-VdpftNhfYcnqEuDbqD4nxZw0_LeXas1u1L9s6_SBFxozepwu24qKp2NLn4m2BlNcps2QN62Ffpijd4Tdwj7gwKkzfTFdmy_YE Aug 12 01:29:18.704981 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Id: None Aug 12 01:29:18.704981 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Name: None Aug 12 01:29:18.704981 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Identity-Status: Confirmed Aug 12 01:29:18.704981 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Is-Admin-Project: True Aug 12 01:29:18.704981 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Id: default Aug 12 01:29:18.704981 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Name: Default Aug 12 01:29:18.704981 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Id: 7cf0858834c84aaa993de55f361d6ed9 Aug 12 01:29:18.704981 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Name: tempest-DeleteServersTestJSON-1853341616 Aug 12 01:29:18.704981 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Role: member,reader Aug 12 01:29:18.704981 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Roles: member,reader Aug 12 01:29:18.706222 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7cf0858834c84aaa993de55f361d6ed9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7cf0858834c84aaa993de55f361d6ed9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7cf0858834c84aaa993de55f361d6ed9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7cf0858834c84aaa993de55f361d6ed9"}]}] Aug 12 01:29:18.706222 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant: tempest-DeleteServersTestJSON-1853341616 Aug 12 01:29:18.706222 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Id: 7cf0858834c84aaa993de55f361d6ed9 Aug 12 01:29:18.706222 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Name: tempest-DeleteServersTestJSON-1853341616 Aug 12 01:29:18.706222 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User: tempest-DeleteServersTestJSON-1853341616-project Aug 12 01:29:18.706222 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Id: default Aug 12 01:29:18.706222 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Name: Default Aug 12 01:29:18.706222 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Id: 023a04369b394bd1b035ab793e0b93b0 Aug 12 01:29:18.706222 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Name: tempest-DeleteServersTestJSON-1853341616-project Aug 12 01:29:18.706222 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: method: > Aug 12 01:29:18.706222 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: exception: Instance 26be209b-84c3-49e2-a869-ea8c00f94851 could not be found. Aug 12 01:29:18.706222 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: action_args: {'id': '26be209b-84c3-49e2-a869-ea8c00f94851'} Aug 12 01:29:18.706950 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:29:18.706950 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:29:18.706950 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:29:18.706950 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:29:18.706950 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:29:18.706950 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:29:18.706950 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:29:18.706950 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:29:18.706950 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:29:18.706950 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:29:18.706950 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26be209b-84c3-49e2-a869-ea8c00f94851 could not be found. Aug 12 01:29:18.706950 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:29:18.706950 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:29:18.706950 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:29:18.706950 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:29:18.706950 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:29:18.706950 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:29:18.706950 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:29:18.706950 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:29:18.706950 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:29:18.708019 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:29:18.708019 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 01:29:18.708019 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 01:29:18.708019 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 01:29:18.708019 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 01:29:18.708019 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:29:18.708019 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:29:18.708019 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:29:18.708019 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:29:18.708019 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26be209b-84c3-49e2-a869-ea8c00f94851 could not be found. Aug 12 01:29:18.708019 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:29:18.708019 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:29:18.708019 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:29:18.708019 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:29:18.708019 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:29:18.708019 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:29:18.708019 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:29:18.708019 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:29:18.708019 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26be209b-84c3-49e2-a869-ea8c00f94851 could not be found. Aug 12 01:29:18.708019 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:29:18.709097 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-cd16b913-a19b-4f80-a42e-2a3da47edb1e tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Returning 404 to user: Instance 26be209b-84c3-49e2-a869-ea8c00f94851 could not be found. {{(pid=120785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:29:18.709097 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-cd16b913-a19b-4f80-a42e-2a3da47edb1e tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] 10.222.0.20 "DELETE /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851" status: 404 len: 111 microversion: 2.1 time: 0.040600 Aug 12 01:29:18.709097 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 79/161] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 01:29:18 2022] DELETE /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 12 01:29:18.715484 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-3f152226-775a-4901-8ae1-99f8aaf48e0e tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:18.716123 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-3f152226-775a-4901-8ae1-99f8aaf48e0e tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] [instance: 26be209b-84c3-49e2-a869-ea8c00f94851] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:18.722407 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3f152226-775a-4901-8ae1-99f8aaf48e0e tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:18.722883 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3f152226-775a-4901-8ae1-99f8aaf48e0e tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:18.723308 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3f152226-775a-4901-8ae1-99f8aaf48e0e tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:18.724082 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3f152226-775a-4901-8ae1-99f8aaf48e0e tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:18.724530 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3f152226-775a-4901-8ae1-99f8aaf48e0e tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:18.724943 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3f152226-775a-4901-8ae1-99f8aaf48e0e tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:18.741363 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.wsgi [None req-3f152226-775a-4901-8ae1-99f8aaf48e0e tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] HTTP exception thrown: Instance 26be209b-84c3-49e2-a869-ea8c00f94851 could not be found. Aug 12 01:29:18.742888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-3f152226-775a-4901-8ae1-99f8aaf48e0e tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Request method failure captured: Aug 12 01:29:18.742888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: request: GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851 HTTP/1.1 Aug 12 01:29:18.742888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept: application/json Aug 12 01:29:18.742888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept-Encoding: identity Aug 12 01:29:18.742888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Connection: close Aug 12 01:29:18.742888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Length: 0 Aug 12 01:29:18.742888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Type: application/json Aug 12 01:29:18.742888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Host: 10.222.0.20 Aug 12 01:29:18.742888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Openstack-System-Scope: None Aug 12 01:29:18.742888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: User-Agent: python-urllib3/1.26.11 Aug 12 01:29:18.742888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Auth-Token: gAAAAABi9ayuN0ih7Jq554kKIfYPN-Y27qiMAena8WRZBHLhCFXgc3Bu_lGw9PseumOaZZlyvAZJrc6Eptz20-VdpftNhfYcnqEuDbqD4nxZw0_LeXas1u1L9s6_SBFxozepwu24qKp2NLn4m2BlNcps2QN62Ffpijd4Tdwj7gwKkzfTFdmy_YE Aug 12 01:29:18.742888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Id: None Aug 12 01:29:18.742888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Name: None Aug 12 01:29:18.742888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Identity-Status: Confirmed Aug 12 01:29:18.742888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Is-Admin-Project: True Aug 12 01:29:18.742888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Id: default Aug 12 01:29:18.742888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Name: Default Aug 12 01:29:18.742888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Id: 7cf0858834c84aaa993de55f361d6ed9 Aug 12 01:29:18.742888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Name: tempest-DeleteServersTestJSON-1853341616 Aug 12 01:29:18.742888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Role: member,reader Aug 12 01:29:18.742888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Roles: member,reader Aug 12 01:29:18.744107 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7cf0858834c84aaa993de55f361d6ed9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7cf0858834c84aaa993de55f361d6ed9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7cf0858834c84aaa993de55f361d6ed9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7cf0858834c84aaa993de55f361d6ed9"}]}] Aug 12 01:29:18.744107 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant: tempest-DeleteServersTestJSON-1853341616 Aug 12 01:29:18.744107 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Id: 7cf0858834c84aaa993de55f361d6ed9 Aug 12 01:29:18.744107 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Name: tempest-DeleteServersTestJSON-1853341616 Aug 12 01:29:18.744107 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User: tempest-DeleteServersTestJSON-1853341616-project Aug 12 01:29:18.744107 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Id: default Aug 12 01:29:18.744107 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Name: Default Aug 12 01:29:18.744107 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Id: 023a04369b394bd1b035ab793e0b93b0 Aug 12 01:29:18.744107 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Name: tempest-DeleteServersTestJSON-1853341616-project Aug 12 01:29:18.744107 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: method: > Aug 12 01:29:18.744107 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: exception: Instance 26be209b-84c3-49e2-a869-ea8c00f94851 could not be found. Aug 12 01:29:18.744107 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: action_args: {'id': '26be209b-84c3-49e2-a869-ea8c00f94851'} Aug 12 01:29:18.744743 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:29:18.744743 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:29:18.744743 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:29:18.744743 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:29:18.744743 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:29:18.744743 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:29:18.744743 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:29:18.744743 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:29:18.744743 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:29:18.744743 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:29:18.744743 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26be209b-84c3-49e2-a869-ea8c00f94851 could not be found. Aug 12 01:29:18.744743 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:29:18.744743 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:29:18.744743 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:29:18.744743 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:29:18.744743 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:29:18.744743 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:29:18.744743 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:29:18.744743 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:29:18.744743 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:29:18.745762 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:29:18.745762 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 01:29:18.745762 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 01:29:18.745762 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:29:18.745762 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:29:18.745762 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:29:18.745762 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:29:18.745762 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26be209b-84c3-49e2-a869-ea8c00f94851 could not be found. Aug 12 01:29:18.745762 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:29:18.745762 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:29:18.745762 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:29:18.745762 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:29:18.745762 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:29:18.745762 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:29:18.745762 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:29:18.745762 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:29:18.745762 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26be209b-84c3-49e2-a869-ea8c00f94851 could not be found. Aug 12 01:29:18.745762 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:29:18.746733 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-3f152226-775a-4901-8ae1-99f8aaf48e0e tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] Returning 404 to user: Instance 26be209b-84c3-49e2-a869-ea8c00f94851 could not be found. {{(pid=120786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:29:18.746733 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-3f152226-775a-4901-8ae1-99f8aaf48e0e tempest-DeleteServersTestJSON-1853341616 tempest-DeleteServersTestJSON-1853341616-project] 10.222.0.20 "GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851" status: 404 len: 111 microversion: 2.1 time: 0.032760 Aug 12 01:29:18.746733 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 83/162] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:18 2022] GET /compute/v2.1/servers/26be209b-84c3-49e2-a869-ea8c00f94851 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:29:19.501377 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-3a1f4e6c-5667-4cb0-9aad-66f7efa8eb99 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:19.502280 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-3a1f4e6c-5667-4cb0-9aad-66f7efa8eb99 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:19.508703 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3a1f4e6c-5667-4cb0-9aad-66f7efa8eb99 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:19.509370 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3a1f4e6c-5667-4cb0-9aad-66f7efa8eb99 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:19.510028 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3a1f4e6c-5667-4cb0-9aad-66f7efa8eb99 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:19.510864 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3a1f4e6c-5667-4cb0-9aad-66f7efa8eb99 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:19.511446 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3a1f4e6c-5667-4cb0-9aad-66f7efa8eb99 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:19.512020 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3a1f4e6c-5667-4cb0-9aad-66f7efa8eb99 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:19.688826 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-3a1f4e6c-5667-4cb0-9aad-66f7efa8eb99 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:19.706711 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-3a1f4e6c-5667-4cb0-9aad-66f7efa8eb99 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.202628 Aug 12 01:29:19.709680 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 80/163] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:19 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:20.728422 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-62d009c2-84ea-4cfc-8b31-d50c3ad548cf tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:20.729149 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-62d009c2-84ea-4cfc-8b31-d50c3ad548cf tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:20.752917 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-62d009c2-84ea-4cfc-8b31-d50c3ad548cf tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:20.755042 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-62d009c2-84ea-4cfc-8b31-d50c3ad548cf tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:20.757942 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-62d009c2-84ea-4cfc-8b31-d50c3ad548cf tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:20.763090 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-62d009c2-84ea-4cfc-8b31-d50c3ad548cf tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:20.763919 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-62d009c2-84ea-4cfc-8b31-d50c3ad548cf tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:20.767098 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-62d009c2-84ea-4cfc-8b31-d50c3ad548cf tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:20.996000 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-62d009c2-84ea-4cfc-8b31-d50c3ad548cf tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:21.008437 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-62d009c2-84ea-4cfc-8b31-d50c3ad548cf tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.285086 Aug 12 01:29:21.009820 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 84/164] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:20 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:22.035364 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-39677167-176b-4335-8bbf-c4cccede9c8f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:22.036105 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-39677167-176b-4335-8bbf-c4cccede9c8f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:22.046822 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-39677167-176b-4335-8bbf-c4cccede9c8f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:22.048276 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-39677167-176b-4335-8bbf-c4cccede9c8f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:22.049774 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-39677167-176b-4335-8bbf-c4cccede9c8f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:22.052022 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-39677167-176b-4335-8bbf-c4cccede9c8f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:22.052767 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-39677167-176b-4335-8bbf-c4cccede9c8f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:22.053479 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-39677167-176b-4335-8bbf-c4cccede9c8f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:22.389055 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-39677167-176b-4335-8bbf-c4cccede9c8f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:22.413630 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-39677167-176b-4335-8bbf-c4cccede9c8f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.381797 Aug 12 01:29:22.414642 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 81/165] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:22 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:23.436783 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-1070b11f-a0f8-4e21-b564-930a2668d321 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:23.445483 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-1070b11f-a0f8-4e21-b564-930a2668d321 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:23.452658 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1070b11f-a0f8-4e21-b564-930a2668d321 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:23.453489 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1070b11f-a0f8-4e21-b564-930a2668d321 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:23.454106 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1070b11f-a0f8-4e21-b564-930a2668d321 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:23.455018 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1070b11f-a0f8-4e21-b564-930a2668d321 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:23.455685 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1070b11f-a0f8-4e21-b564-930a2668d321 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:23.456287 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1070b11f-a0f8-4e21-b564-930a2668d321 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:23.672153 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-1070b11f-a0f8-4e21-b564-930a2668d321 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:23.681985 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-1070b11f-a0f8-4e21-b564-930a2668d321 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.249616 Aug 12 01:29:23.697058 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 85/166] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:23 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:24.209630 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-db6fce65-4893-4072-8e09-bd360d9acd8f tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Action: 'create', calling method: .version_select at 0x7f2decff14c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1851288918", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKtpu5DEf2NxEfqP9aG4rGWoM+ZDeu5wEklqt5MFmm53axOvdIcJKtM5BNB6sbLJd7oL8ZKLbk/MtpFf0P5yiIhWoq3O9LDhAaWtABDVz55ArCiiwwPkmYsBNqfYALL8tQ=="}} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:29:24.256852 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.quota [None req-db6fce65-4893-4072-8e09-bd360d9acd8f tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Getting quotas for project 135531dcbc244552aef21e5d555da3c4. Resources: {'key_pairs'} {{(pid=120785) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 01:29:24.261991 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.quota [None req-db6fce65-4893-4072-8e09-bd360d9acd8f tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Getting quotas for user 15481d01cf6d4c67af858859f74a1607 and project 135531dcbc244552aef21e5d555da3c4. Resources: {'key_pairs'} {{(pid=120785) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 01:29:24.291164 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-db6fce65-4893-4072-8e09-bd360d9acd8f tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.087784 Aug 12 01:29:24.303104 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 82/167] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Aug 12 01:29:24 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 01:29:24.435836 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-f6e45bee-42d7-4609-b0b7-ebfa1b22c6b7 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1305348795", "imageRef": "448b04de-4c0f-41e0-9d0c-d3a985d492ce", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1851288918", "networks": [{"uuid": "d04560af-1d78-44a3-b9e1-6b63b0e806e7"}]}} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:29:24.525000 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.network.neutron [None req-f6e45bee-42d7-4609-b0b7-ebfa1b22c6b7 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] validate_networks() for [('d04560af-1d78-44a3-b9e1-6b63b0e806e7', None, None, None, None, None)] {{(pid=120786) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 01:29:24.706794 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-95d1c945-9eee-44a3-9828-db483e6e6140 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:24.707448 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-95d1c945-9eee-44a3-9828-db483e6e6140 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:24.716147 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-95d1c945-9eee-44a3-9828-db483e6e6140 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:24.716636 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-95d1c945-9eee-44a3-9828-db483e6e6140 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:24.717063 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-95d1c945-9eee-44a3-9828-db483e6e6140 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:24.717762 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-95d1c945-9eee-44a3-9828-db483e6e6140 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:24.718204 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-95d1c945-9eee-44a3-9828-db483e6e6140 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:24.718620 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-95d1c945-9eee-44a3-9828-db483e6e6140 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:25.048356 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-95d1c945-9eee-44a3-9828-db483e6e6140 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:25.066032 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-95d1c945-9eee-44a3-9828-db483e6e6140 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.365497 Aug 12 01:29:25.081242 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 83/168] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:24 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:25.590102 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-6ebfb2f3-1c88-45b9-9ceb-db68925c3b62 tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] Action: 'create', calling method: .version_select at 0x7f2decff8e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1994266133"}} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:29:25.636106 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-f6e45bee-42d7-4609-b0b7-ebfa1b22c6b7 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Flavor limits 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 01:29:25.637020 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-f6e45bee-42d7-4609-b0b7-ebfa1b22c6b7 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Image limits 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 01:29:25.637609 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-f6e45bee-42d7-4609-b0b7-ebfa1b22c6b7 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Flavor pref 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 01:29:25.638223 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-f6e45bee-42d7-4609-b0b7-ebfa1b22c6b7 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Image pref 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 01:29:25.638769 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-f6e45bee-42d7-4609-b0b7-ebfa1b22c6b7 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 01:29:25.651608 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f6e45bee-42d7-4609-b0b7-ebfa1b22c6b7 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:25.652086 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f6e45bee-42d7-4609-b0b7-ebfa1b22c6b7 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:25.652509 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f6e45bee-42d7-4609-b0b7-ebfa1b22c6b7 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:25.653216 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f6e45bee-42d7-4609-b0b7-ebfa1b22c6b7 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:25.653655 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f6e45bee-42d7-4609-b0b7-ebfa1b22c6b7 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:25.654068 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f6e45bee-42d7-4609-b0b7-ebfa1b22c6b7 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:25.676921 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.quota [None req-f6e45bee-42d7-4609-b0b7-ebfa1b22c6b7 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Getting quotas for project 135531dcbc244552aef21e5d555da3c4. Resources: {'cores', 'ram', 'instances'} {{(pid=120786) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 01:29:25.684952 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.quota [None req-f6e45bee-42d7-4609-b0b7-ebfa1b22c6b7 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Getting quotas for user 15481d01cf6d4c67af858859f74a1607 and project 135531dcbc244552aef21e5d555da3c4. Resources: {'cores', 'ram', 'instances'} {{(pid=120786) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 01:29:25.701996 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-f6e45bee-42d7-4609-b0b7-ebfa1b22c6b7 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Going to run 1 instances... {{(pid=120786) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 01:29:25.704315 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-f6e45bee-42d7-4609-b0b7-ebfa1b22c6b7 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='448b04de-4c0f-41e0-9d0c-d3a985d492ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120786) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 01:29:25.764415 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-f6e45bee-42d7-4609-b0b7-ebfa1b22c6b7 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.332516 Aug 12 01:29:25.765339 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 86/169] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 01:29:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1335 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 01:29:25.776888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-909a6817-1bba-460c-83ba-37efabd0a5ed tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:25.777709 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-909a6817-1bba-460c-83ba-37efabd0a5ed tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:25.919300 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-909a6817-1bba-460c-83ba-37efabd0a5ed tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:25.928242 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-909a6817-1bba-460c-83ba-37efabd0a5ed tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1259 microversion: 2.1 time: 0.155344 Aug 12 01:29:25.928802 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 87/170] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:25 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:26.059391 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-6ebfb2f3-1c88-45b9-9ceb-db68925c3b62 tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.684055 Aug 12 01:29:26.060066 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 84/171] 10.222.0.20 () {60 vars in 1155 bytes} [Fri Aug 12 01:29:25 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 686 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 12 01:29:26.075650 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-b0fccca2-346d-4312-bf7b-02c33648cccb tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] Calling method '.version_select at 0x7f2ded12f9d0>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:26.093463 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-6737a0ca-374c-4053-862d-35fce5c42481 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:26.094232 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-6737a0ca-374c-4053-862d-35fce5c42481 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:26.114933 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6737a0ca-374c-4053-862d-35fce5c42481 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:26.115734 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6737a0ca-374c-4053-862d-35fce5c42481 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:26.123822 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6737a0ca-374c-4053-862d-35fce5c42481 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:26.128143 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6737a0ca-374c-4053-862d-35fce5c42481 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:26.128775 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6737a0ca-374c-4053-862d-35fce5c42481 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:26.129256 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6737a0ca-374c-4053-862d-35fce5c42481 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:26.215125 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-b0fccca2-346d-4312-bf7b-02c33648cccb tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/e62ede2e-2227-4c37-822f-e36e04c1b261" status: 200 len: 345 microversion: 2.1 time: 0.146366 Aug 12 01:29:26.221737 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 88/172] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Aug 12 01:29:26 2022] GET /compute/v2.1/os-volumes/e62ede2e-2227-4c37-822f-e36e04c1b261 => generated 345 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:29:26.485885 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-6737a0ca-374c-4053-862d-35fce5c42481 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:26.505125 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-6737a0ca-374c-4053-862d-35fce5c42481 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.416417 Aug 12 01:29:26.507034 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 85/173] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:26 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:26.951904 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-7d97f2a2-3b45-4fb7-9093-c135f6b4ddaa tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:26.953139 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-7d97f2a2-3b45-4fb7-9093-c135f6b4ddaa tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:26.959672 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7d97f2a2-3b45-4fb7-9093-c135f6b4ddaa tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:26.960156 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7d97f2a2-3b45-4fb7-9093-c135f6b4ddaa tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:26.960753 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7d97f2a2-3b45-4fb7-9093-c135f6b4ddaa tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:26.961453 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7d97f2a2-3b45-4fb7-9093-c135f6b4ddaa tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:26.962054 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7d97f2a2-3b45-4fb7-9093-c135f6b4ddaa tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:26.962480 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7d97f2a2-3b45-4fb7-9093-c135f6b4ddaa tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:27.023294 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-7d97f2a2-3b45-4fb7-9093-c135f6b4ddaa tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:27.032139 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-7d97f2a2-3b45-4fb7-9093-c135f6b4ddaa tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1311 microversion: 2.1 time: 0.084506 Aug 12 01:29:27.032652 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 89/174] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:26 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1311 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:27.228848 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-3ca766c9-aa11-423d-8a79-169c0b7a510f tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] Calling method '.version_select at 0x7f2decff89d0>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:27.305505 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-3ca766c9-aa11-423d-8a79-169c0b7a510f tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/e62ede2e-2227-4c37-822f-e36e04c1b261" status: 200 len: 346 microversion: 2.1 time: 0.080372 Aug 12 01:29:27.306393 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 86/175] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Aug 12 01:29:27 2022] GET /compute/v2.1/os-volumes/e62ede2e-2227-4c37-822f-e36e04c1b261 => generated 346 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:29:27.319190 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-7f8bb8ea-8c77-431f-a729-8d48685c3e8f tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] Action: 'create', calling method: .version_select at 0x7f2ded12fee0>, body: {"snapshot": {"volume_id": "e62ede2e-2227-4c37-822f-e36e04c1b261", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1666517070"}} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:29:27.527583 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-61a96d67-4c6f-4670-941c-5f1c0d632f20 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:27.528645 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-61a96d67-4c6f-4670-941c-5f1c0d632f20 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:27.545552 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-61a96d67-4c6f-4670-941c-5f1c0d632f20 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:27.546075 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-61a96d67-4c6f-4670-941c-5f1c0d632f20 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:27.546749 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-61a96d67-4c6f-4670-941c-5f1c0d632f20 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:27.547769 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-61a96d67-4c6f-4670-941c-5f1c0d632f20 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:27.548239 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-61a96d67-4c6f-4670-941c-5f1c0d632f20 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:27.548940 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-61a96d67-4c6f-4670-941c-5f1c0d632f20 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:27.690148 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-7f8bb8ea-8c77-431f-a729-8d48685c3e8f tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.374608 Aug 12 01:29:27.691046 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 90/176] 10.222.0.20 () {60 vars in 1162 bytes} [Fri Aug 12 01:29:27 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:29:27.704710 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-b7aee3d3-8baa-422d-92a4-53eac71319c7 tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] Calling method '.version_select at 0x7f2ded179940>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:27.777928 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-b7aee3d3-8baa-422d-92a4-53eac71319c7 tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/3a01e537-0348-42c8-acc8-71ba1f2d3806" status: 200 len: 287 microversion: 2.1 time: 0.079627 Aug 12 01:29:27.778501 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 91/177] 10.222.0.20 () {58 vars in 1251 bytes} [Fri Aug 12 01:29:27 2022] GET /compute/v2.1/os-snapshots/3a01e537-0348-42c8-acc8-71ba1f2d3806 => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 01:29:27.791974 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-6bb506db-740a-409f-a37f-2945417744e3 tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] Calling method '.version_select at 0x7f2ded03e0d0>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:27.873909 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-6bb506db-740a-409f-a37f-2945417744e3 tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.087846 Aug 12 01:29:27.874485 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 92/178] 10.222.0.20 () {58 vars in 1140 bytes} [Fri Aug 12 01:29:27 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 01:29:27.886424 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-34557f98-2ec9-4ebc-b000-b08976c1d127 tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] Calling method '.version_select at 0x7f2ded03e5e0>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:27.933822 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-34557f98-2ec9-4ebc-b000-b08976c1d127 tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/3a01e537-0348-42c8-acc8-71ba1f2d3806" status: 200 len: 287 microversion: 2.1 time: 0.052152 Aug 12 01:29:27.934656 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 93/179] 10.222.0.20 () {58 vars in 1251 bytes} [Fri Aug 12 01:29:27 2022] GET /compute/v2.1/os-snapshots/3a01e537-0348-42c8-acc8-71ba1f2d3806 => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:29:27.941757 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-61a96d67-4c6f-4670-941c-5f1c0d632f20 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:27.976404 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-61a96d67-4c6f-4670-941c-5f1c0d632f20 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.449645 Aug 12 01:29:28.001570 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 87/180] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:27 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:28.054190 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-136746e6-b1c4-4065-bc2b-db7acf0e7935 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:28.055282 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-136746e6-b1c4-4065-bc2b-db7acf0e7935 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:28.070086 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-136746e6-b1c4-4065-bc2b-db7acf0e7935 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:28.070593 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-136746e6-b1c4-4065-bc2b-db7acf0e7935 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:28.071338 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-136746e6-b1c4-4065-bc2b-db7acf0e7935 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:28.071757 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-136746e6-b1c4-4065-bc2b-db7acf0e7935 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:28.072953 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-136746e6-b1c4-4065-bc2b-db7acf0e7935 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:28.073747 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-136746e6-b1c4-4065-bc2b-db7acf0e7935 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:28.331731 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-136746e6-b1c4-4065-bc2b-db7acf0e7935 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:28.344818 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-136746e6-b1c4-4065-bc2b-db7acf0e7935 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1317 microversion: 2.1 time: 0.294128 Aug 12 01:29:28.345745 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 94/181] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:28 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1317 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:28.946295 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-5a5d7475-3523-4825-ab8c-86bcbf5fdf3d tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] Calling method '.version_select at 0x7f2decff8940>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:29.004123 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-5a6fb28b-60de-4593-89ef-77a3c2138f7d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:29.005115 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-5a6fb28b-60de-4593-89ef-77a3c2138f7d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:29.022365 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-5a5d7475-3523-4825-ab8c-86bcbf5fdf3d tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/3a01e537-0348-42c8-acc8-71ba1f2d3806" status: 200 len: 287 microversion: 2.1 time: 0.079840 Aug 12 01:29:29.023654 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 88/182] 10.222.0.20 () {58 vars in 1251 bytes} [Fri Aug 12 01:29:28 2022] GET /compute/v2.1/os-snapshots/3a01e537-0348-42c8-acc8-71ba1f2d3806 => generated 287 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:29:29.034147 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5a6fb28b-60de-4593-89ef-77a3c2138f7d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:29.037157 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5a6fb28b-60de-4593-89ef-77a3c2138f7d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:29.037817 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5a6fb28b-60de-4593-89ef-77a3c2138f7d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:29.049961 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5a6fb28b-60de-4593-89ef-77a3c2138f7d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:29.050914 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5a6fb28b-60de-4593-89ef-77a3c2138f7d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:29.054147 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5a6fb28b-60de-4593-89ef-77a3c2138f7d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:29.368287 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-902e511b-83c7-4bd5-b37c-b3eb6af6ec05 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:29.372986 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-902e511b-83c7-4bd5-b37c-b3eb6af6ec05 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:29.380344 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-902e511b-83c7-4bd5-b37c-b3eb6af6ec05 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:29.381138 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-902e511b-83c7-4bd5-b37c-b3eb6af6ec05 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:29.381727 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-902e511b-83c7-4bd5-b37c-b3eb6af6ec05 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:29.382593 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-902e511b-83c7-4bd5-b37c-b3eb6af6ec05 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:29.383184 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-902e511b-83c7-4bd5-b37c-b3eb6af6ec05 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:29.385107 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-902e511b-83c7-4bd5-b37c-b3eb6af6ec05 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:29.412776 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:29:29.557855 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-5a6fb28b-60de-4593-89ef-77a3c2138f7d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:29.573021 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-5a6fb28b-60de-4593-89ef-77a3c2138f7d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.578507 Aug 12 01:29:29.576129 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 95/183] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:28 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:29.637277 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-902e511b-83c7-4bd5-b37c-b3eb6af6ec05 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:29.654930 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-902e511b-83c7-4bd5-b37c-b3eb6af6ec05 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1359 microversion: 2.1 time: 0.289794 Aug 12 01:29:29.656210 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 89/184] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:29 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1359 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:30.037875 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-d4e396b1-5e7f-4c34-8c5b-4661e732a9cf tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] Calling method '.version_select at 0x7f2ded05f430>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:30.086234 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-d4e396b1-5e7f-4c34-8c5b-4661e732a9cf tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/3a01e537-0348-42c8-acc8-71ba1f2d3806" status: 200 len: 287 microversion: 2.1 time: 0.054694 Aug 12 01:29:30.093323 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 96/185] 10.222.0.20 () {58 vars in 1251 bytes} [Fri Aug 12 01:29:30 2022] GET /compute/v2.1/os-snapshots/3a01e537-0348-42c8-acc8-71ba1f2d3806 => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:29:30.604027 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-b380eb7a-792e-440b-b0bd-2c27e075ff3d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:30.604646 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-b380eb7a-792e-440b-b0bd-2c27e075ff3d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:30.610827 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b380eb7a-792e-440b-b0bd-2c27e075ff3d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:30.611307 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b380eb7a-792e-440b-b0bd-2c27e075ff3d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:30.611780 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b380eb7a-792e-440b-b0bd-2c27e075ff3d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:30.612469 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b380eb7a-792e-440b-b0bd-2c27e075ff3d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:30.613100 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b380eb7a-792e-440b-b0bd-2c27e075ff3d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:30.613667 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b380eb7a-792e-440b-b0bd-2c27e075ff3d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:30.677727 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-3ad7edd1-f78d-4569-a9bc-212a0550c3e5 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:30.678675 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-3ad7edd1-f78d-4569-a9bc-212a0550c3e5 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:30.717667 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3ad7edd1-f78d-4569-a9bc-212a0550c3e5 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:30.718158 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3ad7edd1-f78d-4569-a9bc-212a0550c3e5 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:30.718586 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3ad7edd1-f78d-4569-a9bc-212a0550c3e5 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:30.719285 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3ad7edd1-f78d-4569-a9bc-212a0550c3e5 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:30.724750 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3ad7edd1-f78d-4569-a9bc-212a0550c3e5 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:30.725428 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3ad7edd1-f78d-4569-a9bc-212a0550c3e5 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:30.815699 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell1:SELECT=100 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:29:30.877981 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-b380eb7a-792e-440b-b0bd-2c27e075ff3d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:30.888165 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-b380eb7a-792e-440b-b0bd-2c27e075ff3d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.290149 Aug 12 01:29:30.904699 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 90/186] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:30 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:31.042823 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-3ad7edd1-f78d-4569-a9bc-212a0550c3e5 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:31.051490 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-3ad7edd1-f78d-4569-a9bc-212a0550c3e5 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1359 microversion: 2.1 time: 0.378214 Aug 12 01:29:31.052100 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 97/187] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:30 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1359 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:29:31.101261 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-1211b78f-2f8b-47ed-b32a-2c277a15db9f tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] Calling method '.version_select at 0x7f2decff1550>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:31.165256 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-1211b78f-2f8b-47ed-b32a-2c277a15db9f tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/3a01e537-0348-42c8-acc8-71ba1f2d3806" status: 200 len: 288 microversion: 2.1 time: 0.070306 Aug 12 01:29:31.178689 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-8be2660a-4a9e-42c2-8977-c14b1b97a26b tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] Calling method '.version_select at 0x7f2ded09ee50>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:31.179339 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 91/188] 10.222.0.20 () {58 vars in 1251 bytes} [Fri Aug 12 01:29:31 2022] GET /compute/v2.1/os-snapshots/3a01e537-0348-42c8-acc8-71ba1f2d3806 => generated 288 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:29:31.286854 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-8be2660a-4a9e-42c2-8977-c14b1b97a26b tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/3a01e537-0348-42c8-acc8-71ba1f2d3806" status: 202 len: 0 microversion: 2.1 time: 0.112629 Aug 12 01:29:31.287683 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 98/189] 10.222.0.20 () {58 vars in 1254 bytes} [Fri Aug 12 01:29:31 2022] DELETE /compute/v2.1/os-snapshots/3a01e537-0348-42c8-acc8-71ba1f2d3806 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 01:29:31.296892 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-a025363c-a916-44a0-b787-701c5924668a tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] Calling method '.version_select at 0x7f2decff18b0>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:31.366200 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-a025363c-a916-44a0-b787-701c5924668a tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/3a01e537-0348-42c8-acc8-71ba1f2d3806" status: 200 len: 287 microversion: 2.1 time: 0.073620 Aug 12 01:29:31.366772 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 92/190] 10.222.0.20 () {58 vars in 1251 bytes} [Fri Aug 12 01:29:31 2022] GET /compute/v2.1/os-snapshots/3a01e537-0348-42c8-acc8-71ba1f2d3806 => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:29:31.914913 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-ab0f57a1-75b7-4ab9-b0b8-4f5a19f683cb tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:31.918471 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-ab0f57a1-75b7-4ab9-b0b8-4f5a19f683cb tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:31.925419 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ab0f57a1-75b7-4ab9-b0b8-4f5a19f683cb tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:31.929316 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ab0f57a1-75b7-4ab9-b0b8-4f5a19f683cb tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:31.930207 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ab0f57a1-75b7-4ab9-b0b8-4f5a19f683cb tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:31.932491 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ab0f57a1-75b7-4ab9-b0b8-4f5a19f683cb tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:31.935681 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ab0f57a1-75b7-4ab9-b0b8-4f5a19f683cb tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:31.938919 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ab0f57a1-75b7-4ab9-b0b8-4f5a19f683cb tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:32.073195 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-85daef41-e7ff-4c0c-9432-3b748aad0824 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:32.073882 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-85daef41-e7ff-4c0c-9432-3b748aad0824 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:32.089855 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-85daef41-e7ff-4c0c-9432-3b748aad0824 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:32.091196 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-85daef41-e7ff-4c0c-9432-3b748aad0824 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:32.092465 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-85daef41-e7ff-4c0c-9432-3b748aad0824 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:32.096156 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-85daef41-e7ff-4c0c-9432-3b748aad0824 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:32.099433 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-85daef41-e7ff-4c0c-9432-3b748aad0824 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:32.101287 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-85daef41-e7ff-4c0c-9432-3b748aad0824 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:32.654483 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-ab0f57a1-75b7-4ab9-b0b8-4f5a19f683cb tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:32.665957 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-ab0f57a1-75b7-4ab9-b0b8-4f5a19f683cb tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.757972 Aug 12 01:29:32.666538 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 99/191] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:31 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:32.683265 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-8aa1e62d-c7bc-48b8-9c43-9f69dd095d06 tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] Calling method '.version_select at 0x7f2ded054430>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:32.772327 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.wsgi [None req-8aa1e62d-c7bc-48b8-9c43-9f69dd095d06 tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] HTTP exception thrown: Snapshot 3a01e537-0348-42c8-acc8-71ba1f2d3806 could not be found. Aug 12 01:29:32.772813 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-85daef41-e7ff-4c0c-9432-3b748aad0824 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:32.774603 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-8aa1e62d-c7bc-48b8-9c43-9f69dd095d06 tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] Request method failure captured: Aug 12 01:29:32.774603 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: request: GET /compute/v2.1/os-snapshots/3a01e537-0348-42c8-acc8-71ba1f2d3806 HTTP/1.1 Aug 12 01:29:32.774603 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept: application/json Aug 12 01:29:32.774603 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept-Encoding: identity Aug 12 01:29:32.774603 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Connection: close Aug 12 01:29:32.774603 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Length: 0 Aug 12 01:29:32.774603 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Type: application/json Aug 12 01:29:32.774603 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Host: 10.222.0.20 Aug 12 01:29:32.774603 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Openstack-System-Scope: None Aug 12 01:29:32.774603 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: User-Agent: python-urllib3/1.26.11 Aug 12 01:29:32.774603 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Auth-Token: gAAAAABi9az15e3UdjyJN7czjM6hRpFAv4rQKXDR973MxkHelFhRHTlOk-XqgroaaTRWvamlVQhJ0oUddmKmmsVK1QAoWmYgD7UkdAatZLrTUdiEjUshZ9W7_xuUSJDnH4Qe2dhlKUR_yg2vK5A_iA2us0cHfzUX7sURPAEPBwC96P4n-E0FR9g Aug 12 01:29:32.774603 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Id: None Aug 12 01:29:32.774603 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Name: None Aug 12 01:29:32.774603 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Identity-Status: Confirmed Aug 12 01:29:32.774603 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Is-Admin-Project: True Aug 12 01:29:32.774603 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Id: default Aug 12 01:29:32.774603 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Name: Default Aug 12 01:29:32.774603 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Id: 599068aceff449c789efeb66c0ad36d2 Aug 12 01:29:32.774603 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1344521267 Aug 12 01:29:32.774603 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Role: member,reader Aug 12 01:29:32.774603 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Roles: member,reader Aug 12 01:29:32.776050 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/599068aceff449c789efeb66c0ad36d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/599068aceff449c789efeb66c0ad36d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_599068aceff449c789efeb66c0ad36d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/599068aceff449c789efeb66c0ad36d2"}]}] Aug 12 01:29:32.776050 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1344521267 Aug 12 01:29:32.776050 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Id: 599068aceff449c789efeb66c0ad36d2 Aug 12 01:29:32.776050 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1344521267 Aug 12 01:29:32.776050 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User: tempest-VolumesSnapshotsTestJSON-1344521267-project Aug 12 01:29:32.776050 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Id: default Aug 12 01:29:32.776050 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Name: Default Aug 12 01:29:32.776050 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Id: 49ef5976baa3428ab260b06abb236818 Aug 12 01:29:32.776050 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1344521267-project Aug 12 01:29:32.776050 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: method: Aug 12 01:29:32.776050 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: exception: Snapshot 3a01e537-0348-42c8-acc8-71ba1f2d3806 could not be found. Aug 12 01:29:32.776050 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: action_args: {'id': '3a01e537-0348-42c8-acc8-71ba1f2d3806'} Aug 12 01:29:32.776050 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:29:32.776854 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:29:32.776854 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 12 01:29:32.776854 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 12 01:29:32.776854 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 12 01:29:32.776854 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 12 01:29:32.776854 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 12 01:29:32.776854 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 12 01:29:32.776854 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 01:29:32.776854 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 01:29:32.776854 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 01:29:32.776854 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 01:29:32.776854 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 01:29:32.776854 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 01:29:32.776854 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 01:29:32.776854 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 01:29:32.776854 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 3a01e537-0348-42c8-acc8-71ba1f2d3806 could not be found. (HTTP 404) (Request-ID: req-450d61c6-ac4b-4c2a-8d57-c269ef9ad47b) Aug 12 01:29:32.776854 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:29:32.776854 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:29:32.778282 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:29:32.778282 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:29:32.778282 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 12 01:29:32.778282 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 12 01:29:32.778282 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 01:29:32.778282 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 01:29:32.778282 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 12 01:29:32.778282 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 12 01:29:32.778282 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 01:29:32.778282 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 01:29:32.778282 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 12 01:29:32.778282 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 12 01:29:32.778282 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 12 01:29:32.778282 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 12 01:29:32.778282 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 12 01:29:32.778282 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 12 01:29:32.778282 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 01:29:32.778282 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 01:29:32.778282 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 01:29:32.779616 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 01:29:32.779616 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 01:29:32.779616 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 01:29:32.779616 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 01:29:32.779616 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 01:29:32.779616 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 3a01e537-0348-42c8-acc8-71ba1f2d3806 could not be found. Aug 12 01:29:32.779616 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:29:32.779616 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:29:32.779616 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:29:32.779616 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:29:32.779616 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:29:32.779616 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:29:32.779616 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:29:32.779616 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:29:32.779616 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 01:29:32.779616 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 01:29:32.779616 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:29:32.779616 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:29:32.779616 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 12 01:29:32.779616 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:29:32.781070 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 3a01e537-0348-42c8-acc8-71ba1f2d3806 could not be found. Aug 12 01:29:32.781070 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:29:32.781070 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:29:32.781070 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:29:32.781070 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:29:32.781070 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:29:32.781070 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:29:32.781070 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:29:32.781070 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:29:32.781070 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 3a01e537-0348-42c8-acc8-71ba1f2d3806 could not be found. Aug 12 01:29:32.781070 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:29:32.781877 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-85daef41-e7ff-4c0c-9432-3b748aad0824 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1359 microversion: 2.1 time: 0.712274 Aug 12 01:29:32.781877 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 93/192] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:32 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1359 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:29:32.783490 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-8aa1e62d-c7bc-48b8-9c43-9f69dd095d06 tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] Returning 404 to user: Snapshot 3a01e537-0348-42c8-acc8-71ba1f2d3806 could not be found. {{(pid=120786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:29:32.784591 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-8aa1e62d-c7bc-48b8-9c43-9f69dd095d06 tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/3a01e537-0348-42c8-acc8-71ba1f2d3806" status: 404 len: 111 microversion: 2.1 time: 0.117081 Aug 12 01:29:32.785846 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 100/193] 10.222.0.20 () {58 vars in 1251 bytes} [Fri Aug 12 01:29:32 2022] GET /compute/v2.1/os-snapshots/3a01e537-0348-42c8-acc8-71ba1f2d3806 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:29:32.804624 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-e8448049-c554-4027-a951-4951cc51147e tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] Calling method '.version_select at 0x7f2decff1e50>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:32.941698 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-e8448049-c554-4027-a951-4951cc51147e tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/e62ede2e-2227-4c37-822f-e36e04c1b261" status: 202 len: 0 microversion: 2.1 time: 0.146671 Aug 12 01:29:32.948853 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 94/194] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Aug 12 01:29:32 2022] DELETE /compute/v2.1/os-volumes/e62ede2e-2227-4c37-822f-e36e04c1b261 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 01:29:32.956062 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-8da2b342-91ed-421c-a071-1fcd390ce959 tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] Calling method '.version_select at 0x7f2ded12f160>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:33.118343 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-8da2b342-91ed-421c-a071-1fcd390ce959 tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/e62ede2e-2227-4c37-822f-e36e04c1b261" status: 200 len: 345 microversion: 2.1 time: 0.168371 Aug 12 01:29:33.119171 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 101/195] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Aug 12 01:29:32 2022] GET /compute/v2.1/os-volumes/e62ede2e-2227-4c37-822f-e36e04c1b261 => generated 345 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 01:29:33.692257 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-1a9bd8c7-463f-45b7-ad0e-afd723b59007 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:33.693398 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-1a9bd8c7-463f-45b7-ad0e-afd723b59007 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:33.721812 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1a9bd8c7-463f-45b7-ad0e-afd723b59007 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:33.722375 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1a9bd8c7-463f-45b7-ad0e-afd723b59007 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:33.722814 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1a9bd8c7-463f-45b7-ad0e-afd723b59007 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:33.723902 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1a9bd8c7-463f-45b7-ad0e-afd723b59007 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:33.729453 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1a9bd8c7-463f-45b7-ad0e-afd723b59007 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:33.729965 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1a9bd8c7-463f-45b7-ad0e-afd723b59007 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:33.804918 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-a39a7516-01a3-46fb-8708-0a40e64b1193 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:33.806271 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-a39a7516-01a3-46fb-8708-0a40e64b1193 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:33.808448 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:29:33.823318 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a39a7516-01a3-46fb-8708-0a40e64b1193 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:33.825916 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a39a7516-01a3-46fb-8708-0a40e64b1193 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:33.827902 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a39a7516-01a3-46fb-8708-0a40e64b1193 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:33.828979 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a39a7516-01a3-46fb-8708-0a40e64b1193 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:33.830346 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a39a7516-01a3-46fb-8708-0a40e64b1193 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:33.832649 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a39a7516-01a3-46fb-8708-0a40e64b1193 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:34.269020 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-1a9bd8c7-463f-45b7-ad0e-afd723b59007 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:34.272189 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell0:SELECT=4 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:29:34.297712 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-1a9bd8c7-463f-45b7-ad0e-afd723b59007 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.600734 Aug 12 01:29:34.298782 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 95/196] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:33 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:34.304518 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-6c6510bc-1377-48f5-b39f-8f1e12a363ec tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] Calling method '.version_select at 0x7f2decff8ee0>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:34.371747 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.wsgi [None req-6c6510bc-1377-48f5-b39f-8f1e12a363ec tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] HTTP exception thrown: Volume e62ede2e-2227-4c37-822f-e36e04c1b261 could not be found. Aug 12 01:29:34.373885 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-6c6510bc-1377-48f5-b39f-8f1e12a363ec tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] Request method failure captured: Aug 12 01:29:34.373885 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: request: GET /compute/v2.1/os-volumes/e62ede2e-2227-4c37-822f-e36e04c1b261 HTTP/1.1 Aug 12 01:29:34.373885 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept: application/json Aug 12 01:29:34.373885 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept-Encoding: identity Aug 12 01:29:34.373885 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Connection: close Aug 12 01:29:34.373885 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Length: 0 Aug 12 01:29:34.373885 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Type: application/json Aug 12 01:29:34.373885 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Host: 10.222.0.20 Aug 12 01:29:34.373885 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Openstack-System-Scope: None Aug 12 01:29:34.373885 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: User-Agent: python-urllib3/1.26.11 Aug 12 01:29:34.373885 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Auth-Token: gAAAAABi9az15e3UdjyJN7czjM6hRpFAv4rQKXDR973MxkHelFhRHTlOk-XqgroaaTRWvamlVQhJ0oUddmKmmsVK1QAoWmYgD7UkdAatZLrTUdiEjUshZ9W7_xuUSJDnH4Qe2dhlKUR_yg2vK5A_iA2us0cHfzUX7sURPAEPBwC96P4n-E0FR9g Aug 12 01:29:34.373885 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Id: None Aug 12 01:29:34.373885 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Name: None Aug 12 01:29:34.373885 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Identity-Status: Confirmed Aug 12 01:29:34.373885 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Is-Admin-Project: True Aug 12 01:29:34.373885 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Id: default Aug 12 01:29:34.373885 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Name: Default Aug 12 01:29:34.373885 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Id: 599068aceff449c789efeb66c0ad36d2 Aug 12 01:29:34.373885 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1344521267 Aug 12 01:29:34.373885 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Role: member,reader Aug 12 01:29:34.373885 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Roles: member,reader Aug 12 01:29:34.375434 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/599068aceff449c789efeb66c0ad36d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/599068aceff449c789efeb66c0ad36d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_599068aceff449c789efeb66c0ad36d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/599068aceff449c789efeb66c0ad36d2"}]}] Aug 12 01:29:34.375434 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1344521267 Aug 12 01:29:34.375434 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Id: 599068aceff449c789efeb66c0ad36d2 Aug 12 01:29:34.375434 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1344521267 Aug 12 01:29:34.375434 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User: tempest-VolumesSnapshotsTestJSON-1344521267-project Aug 12 01:29:34.375434 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Id: default Aug 12 01:29:34.375434 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Name: Default Aug 12 01:29:34.375434 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Id: 49ef5976baa3428ab260b06abb236818 Aug 12 01:29:34.375434 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1344521267-project Aug 12 01:29:34.375434 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: method: Aug 12 01:29:34.375434 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: exception: Volume e62ede2e-2227-4c37-822f-e36e04c1b261 could not be found. Aug 12 01:29:34.375434 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: action_args: {'id': 'e62ede2e-2227-4c37-822f-e36e04c1b261'} Aug 12 01:29:34.375434 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:29:34.376378 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:29:34.376378 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 01:29:34.376378 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 01:29:34.376378 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 01:29:34.376378 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 01:29:34.376378 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 01:29:34.376378 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 01:29:34.376378 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 01:29:34.376378 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 01:29:34.376378 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 01:29:34.376378 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 01:29:34.376378 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 01:29:34.376378 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 01:29:34.376378 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 01:29:34.376378 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 01:29:34.376378 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e62ede2e-2227-4c37-822f-e36e04c1b261 could not be found. (HTTP 404) (Request-ID: req-ae56457c-b880-4916-bebc-9d520f00eaaf) Aug 12 01:29:34.376378 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:29:34.376378 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:29:34.376378 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:29:34.378201 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:29:34.378201 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 12 01:29:34.378201 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 12 01:29:34.378201 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 01:29:34.378201 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 01:29:34.378201 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 12 01:29:34.378201 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 12 01:29:34.378201 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 01:29:34.378201 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 01:29:34.378201 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 01:29:34.378201 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 01:29:34.378201 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 01:29:34.378201 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 01:29:34.378201 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 01:29:34.378201 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 01:29:34.378201 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 01:29:34.378201 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 01:29:34.378201 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 01:29:34.378201 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 01:29:34.379520 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 01:29:34.379520 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 01:29:34.379520 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 01:29:34.379520 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 01:29:34.379520 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e62ede2e-2227-4c37-822f-e36e04c1b261 could not be found. Aug 12 01:29:34.379520 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:29:34.379520 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:29:34.379520 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:29:34.379520 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:29:34.379520 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:29:34.379520 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:29:34.379520 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:29:34.379520 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:29:34.379520 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 01:29:34.379520 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 01:29:34.379520 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:29:34.379520 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:29:34.379520 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 12 01:29:34.379520 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:29:34.380884 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e62ede2e-2227-4c37-822f-e36e04c1b261 could not be found. Aug 12 01:29:34.380884 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:29:34.380884 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:29:34.380884 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:29:34.380884 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:29:34.380884 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:29:34.380884 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:29:34.380884 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:29:34.380884 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:29:34.380884 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e62ede2e-2227-4c37-822f-e36e04c1b261 could not be found. Aug 12 01:29:34.380884 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:29:34.380884 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-6c6510bc-1377-48f5-b39f-8f1e12a363ec tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] Returning 404 to user: Volume e62ede2e-2227-4c37-822f-e36e04c1b261 could not be found. {{(pid=120785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:29:34.380884 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-6c6510bc-1377-48f5-b39f-8f1e12a363ec tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/e62ede2e-2227-4c37-822f-e36e04c1b261" status: 404 len: 109 microversion: 2.1 time: 0.075405 Aug 12 01:29:34.380884 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 96/197] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Aug 12 01:29:34 2022] GET /compute/v2.1/os-volumes/e62ede2e-2227-4c37-822f-e36e04c1b261 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:29:34.388954 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-ee846e47-246b-4506-9202-9d9f083f903f tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] Calling method '.version_select at 0x7f2ded009790>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:34.395441 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-a39a7516-01a3-46fb-8708-0a40e64b1193 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:34.417536 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-a39a7516-01a3-46fb-8708-0a40e64b1193 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1359 microversion: 2.1 time: 0.618602 Aug 12 01:29:34.442392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 102/198] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:33 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1359 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:34.450770 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.wsgi [None req-ee846e47-246b-4506-9202-9d9f083f903f tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] HTTP exception thrown: Volume e62ede2e-2227-4c37-822f-e36e04c1b261 could not be found. Aug 12 01:29:34.452934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-ee846e47-246b-4506-9202-9d9f083f903f tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] Request method failure captured: Aug 12 01:29:34.452934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: request: DELETE /compute/v2.1/os-volumes/e62ede2e-2227-4c37-822f-e36e04c1b261 HTTP/1.1 Aug 12 01:29:34.452934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept: application/json Aug 12 01:29:34.452934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept-Encoding: identity Aug 12 01:29:34.452934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Connection: close Aug 12 01:29:34.452934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Length: 0 Aug 12 01:29:34.452934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Type: application/json Aug 12 01:29:34.452934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Host: 10.222.0.20 Aug 12 01:29:34.452934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Openstack-System-Scope: None Aug 12 01:29:34.452934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: User-Agent: python-urllib3/1.26.11 Aug 12 01:29:34.452934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Auth-Token: gAAAAABi9az15e3UdjyJN7czjM6hRpFAv4rQKXDR973MxkHelFhRHTlOk-XqgroaaTRWvamlVQhJ0oUddmKmmsVK1QAoWmYgD7UkdAatZLrTUdiEjUshZ9W7_xuUSJDnH4Qe2dhlKUR_yg2vK5A_iA2us0cHfzUX7sURPAEPBwC96P4n-E0FR9g Aug 12 01:29:34.452934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Id: None Aug 12 01:29:34.452934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Name: None Aug 12 01:29:34.452934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Identity-Status: Confirmed Aug 12 01:29:34.452934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Is-Admin-Project: True Aug 12 01:29:34.452934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Id: default Aug 12 01:29:34.452934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Name: Default Aug 12 01:29:34.452934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Id: 599068aceff449c789efeb66c0ad36d2 Aug 12 01:29:34.452934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1344521267 Aug 12 01:29:34.452934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Role: member,reader Aug 12 01:29:34.452934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Roles: member,reader Aug 12 01:29:34.454370 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/599068aceff449c789efeb66c0ad36d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/599068aceff449c789efeb66c0ad36d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_599068aceff449c789efeb66c0ad36d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/599068aceff449c789efeb66c0ad36d2"}]}] Aug 12 01:29:34.454370 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1344521267 Aug 12 01:29:34.454370 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Id: 599068aceff449c789efeb66c0ad36d2 Aug 12 01:29:34.454370 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1344521267 Aug 12 01:29:34.454370 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User: tempest-VolumesSnapshotsTestJSON-1344521267-project Aug 12 01:29:34.454370 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Id: default Aug 12 01:29:34.454370 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Name: Default Aug 12 01:29:34.454370 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Id: 49ef5976baa3428ab260b06abb236818 Aug 12 01:29:34.454370 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1344521267-project Aug 12 01:29:34.454370 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: method: Aug 12 01:29:34.454370 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: exception: Volume e62ede2e-2227-4c37-822f-e36e04c1b261 could not be found. Aug 12 01:29:34.454370 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: action_args: {'id': 'e62ede2e-2227-4c37-822f-e36e04c1b261'} Aug 12 01:29:34.454370 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:29:34.455244 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:29:34.455244 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 01:29:34.455244 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 01:29:34.455244 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 12 01:29:34.455244 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 12 01:29:34.455244 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 12 01:29:34.455244 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 12 01:29:34.455244 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 12 01:29:34.455244 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 12 01:29:34.455244 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 12 01:29:34.455244 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 12 01:29:34.455244 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 01:29:34.455244 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 01:29:34.455244 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 01:29:34.455244 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 01:29:34.455244 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e62ede2e-2227-4c37-822f-e36e04c1b261 could not be found. (HTTP 404) (Request-ID: req-78ac9d52-5982-492d-a8e5-5a90473195c3) Aug 12 01:29:34.455244 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:29:34.455244 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:29:34.455244 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:29:34.456791 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:29:34.456791 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 12 01:29:34.456791 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 12 01:29:34.456791 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 01:29:34.456791 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 01:29:34.456791 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 12 01:29:34.456791 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 12 01:29:34.456791 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 01:29:34.456791 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 01:29:34.456791 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 01:29:34.456791 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 01:29:34.456791 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 12 01:29:34.456791 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 12 01:29:34.456791 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 12 01:29:34.456791 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 12 01:29:34.456791 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 12 01:29:34.456791 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 12 01:29:34.456791 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 12 01:29:34.456791 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 12 01:29:34.458155 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 01:29:34.458155 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 01:29:34.458155 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 01:29:34.458155 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 01:29:34.458155 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e62ede2e-2227-4c37-822f-e36e04c1b261 could not be found. Aug 12 01:29:34.458155 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:29:34.458155 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:29:34.458155 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:29:34.458155 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:29:34.458155 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:29:34.458155 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:29:34.458155 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:29:34.458155 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:29:34.458155 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 01:29:34.458155 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 01:29:34.458155 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:29:34.458155 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:29:34.458155 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 12 01:29:34.458155 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:29:34.459897 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e62ede2e-2227-4c37-822f-e36e04c1b261 could not be found. Aug 12 01:29:34.459897 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:29:34.459897 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:29:34.459897 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:29:34.459897 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:29:34.459897 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:29:34.459897 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:29:34.459897 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:29:34.459897 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:29:34.459897 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e62ede2e-2227-4c37-822f-e36e04c1b261 could not be found. Aug 12 01:29:34.459897 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:29:34.459897 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-ee846e47-246b-4506-9202-9d9f083f903f tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] Returning 404 to user: Volume e62ede2e-2227-4c37-822f-e36e04c1b261 could not be found. {{(pid=120785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:29:34.459897 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-ee846e47-246b-4506-9202-9d9f083f903f tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/e62ede2e-2227-4c37-822f-e36e04c1b261" status: 404 len: 109 microversion: 2.1 time: 0.071774 Aug 12 01:29:34.459897 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 97/199] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Aug 12 01:29:34 2022] DELETE /compute/v2.1/os-volumes/e62ede2e-2227-4c37-822f-e36e04c1b261 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:29:34.477295 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-ee39e056-9ce8-4aa8-96af-4549efe6cc4a tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] Calling method '.version_select at 0x7f2ded179b80>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:34.560614 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.wsgi [None req-ee39e056-9ce8-4aa8-96af-4549efe6cc4a tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] HTTP exception thrown: Volume e62ede2e-2227-4c37-822f-e36e04c1b261 could not be found. Aug 12 01:29:34.564390 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-ee39e056-9ce8-4aa8-96af-4549efe6cc4a tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] Request method failure captured: Aug 12 01:29:34.564390 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: request: GET /compute/v2.1/os-volumes/e62ede2e-2227-4c37-822f-e36e04c1b261 HTTP/1.1 Aug 12 01:29:34.564390 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept: application/json Aug 12 01:29:34.564390 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept-Encoding: identity Aug 12 01:29:34.564390 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Connection: close Aug 12 01:29:34.564390 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Length: 0 Aug 12 01:29:34.564390 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Type: application/json Aug 12 01:29:34.564390 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Host: 10.222.0.20 Aug 12 01:29:34.564390 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Openstack-System-Scope: None Aug 12 01:29:34.564390 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: User-Agent: python-urllib3/1.26.11 Aug 12 01:29:34.564390 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Auth-Token: gAAAAABi9az15e3UdjyJN7czjM6hRpFAv4rQKXDR973MxkHelFhRHTlOk-XqgroaaTRWvamlVQhJ0oUddmKmmsVK1QAoWmYgD7UkdAatZLrTUdiEjUshZ9W7_xuUSJDnH4Qe2dhlKUR_yg2vK5A_iA2us0cHfzUX7sURPAEPBwC96P4n-E0FR9g Aug 12 01:29:34.564390 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Id: None Aug 12 01:29:34.564390 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Name: None Aug 12 01:29:34.564390 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Identity-Status: Confirmed Aug 12 01:29:34.564390 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Is-Admin-Project: True Aug 12 01:29:34.564390 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Id: default Aug 12 01:29:34.564390 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Name: Default Aug 12 01:29:34.564390 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Id: 599068aceff449c789efeb66c0ad36d2 Aug 12 01:29:34.564390 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1344521267 Aug 12 01:29:34.564390 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Role: member,reader Aug 12 01:29:34.564390 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Roles: member,reader Aug 12 01:29:34.565851 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/599068aceff449c789efeb66c0ad36d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/599068aceff449c789efeb66c0ad36d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_599068aceff449c789efeb66c0ad36d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/599068aceff449c789efeb66c0ad36d2"}]}] Aug 12 01:29:34.565851 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1344521267 Aug 12 01:29:34.565851 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Id: 599068aceff449c789efeb66c0ad36d2 Aug 12 01:29:34.565851 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1344521267 Aug 12 01:29:34.565851 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User: tempest-VolumesSnapshotsTestJSON-1344521267-project Aug 12 01:29:34.565851 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Id: default Aug 12 01:29:34.565851 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Name: Default Aug 12 01:29:34.565851 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Id: 49ef5976baa3428ab260b06abb236818 Aug 12 01:29:34.565851 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1344521267-project Aug 12 01:29:34.565851 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: method: Aug 12 01:29:34.565851 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: exception: Volume e62ede2e-2227-4c37-822f-e36e04c1b261 could not be found. Aug 12 01:29:34.565851 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: action_args: {'id': 'e62ede2e-2227-4c37-822f-e36e04c1b261'} Aug 12 01:29:34.565851 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:29:34.566824 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:29:34.566824 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 01:29:34.566824 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 01:29:34.566824 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 01:29:34.566824 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 01:29:34.566824 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 01:29:34.566824 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 01:29:34.566824 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 01:29:34.566824 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 01:29:34.566824 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 01:29:34.566824 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 01:29:34.566824 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 01:29:34.566824 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 01:29:34.566824 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 01:29:34.566824 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 01:29:34.566824 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e62ede2e-2227-4c37-822f-e36e04c1b261 could not be found. (HTTP 404) (Request-ID: req-47ca88fe-b3b4-4c7c-9ed1-87ef8f8ff197) Aug 12 01:29:34.566824 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:29:34.566824 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:29:34.566824 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:29:34.568158 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:29:34.568158 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 12 01:29:34.568158 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 12 01:29:34.568158 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 01:29:34.568158 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 01:29:34.568158 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 12 01:29:34.568158 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 12 01:29:34.568158 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 01:29:34.568158 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 01:29:34.568158 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 01:29:34.568158 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 01:29:34.568158 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 01:29:34.568158 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 01:29:34.568158 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 01:29:34.568158 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 01:29:34.568158 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 01:29:34.568158 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 01:29:34.568158 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 01:29:34.568158 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 01:29:34.569693 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 01:29:34.569693 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 01:29:34.569693 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 01:29:34.569693 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 01:29:34.569693 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e62ede2e-2227-4c37-822f-e36e04c1b261 could not be found. Aug 12 01:29:34.569693 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:29:34.569693 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:29:34.569693 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:29:34.569693 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:29:34.569693 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:29:34.569693 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:29:34.569693 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:29:34.569693 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:29:34.569693 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 01:29:34.569693 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 01:29:34.569693 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:29:34.569693 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:29:34.569693 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 12 01:29:34.569693 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:29:34.570977 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e62ede2e-2227-4c37-822f-e36e04c1b261 could not be found. Aug 12 01:29:34.570977 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:29:34.570977 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:29:34.570977 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:29:34.570977 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:29:34.570977 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:29:34.570977 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:29:34.570977 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:29:34.570977 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:29:34.570977 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e62ede2e-2227-4c37-822f-e36e04c1b261 could not be found. Aug 12 01:29:34.570977 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:29:34.570977 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-ee39e056-9ce8-4aa8-96af-4549efe6cc4a tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] Returning 404 to user: Volume e62ede2e-2227-4c37-822f-e36e04c1b261 could not be found. {{(pid=120786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:29:34.570977 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-ee39e056-9ce8-4aa8-96af-4549efe6cc4a tempest-VolumesSnapshotsTestJSON-1344521267 tempest-VolumesSnapshotsTestJSON-1344521267-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/e62ede2e-2227-4c37-822f-e36e04c1b261" status: 404 len: 109 microversion: 2.1 time: 0.096762 Aug 12 01:29:34.576154 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 103/200] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Aug 12 01:29:34 2022] GET /compute/v2.1/os-volumes/e62ede2e-2227-4c37-822f-e36e04c1b261 => generated 109 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:29:35.319352 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-a4b0a7f8-ed73-4c84-bacd-03745d11a441 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:35.320252 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-a4b0a7f8-ed73-4c84-bacd-03745d11a441 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:35.336918 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a4b0a7f8-ed73-4c84-bacd-03745d11a441 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:35.337414 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a4b0a7f8-ed73-4c84-bacd-03745d11a441 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:35.337849 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a4b0a7f8-ed73-4c84-bacd-03745d11a441 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:35.338552 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a4b0a7f8-ed73-4c84-bacd-03745d11a441 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:35.348363 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a4b0a7f8-ed73-4c84-bacd-03745d11a441 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:35.348806 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a4b0a7f8-ed73-4c84-bacd-03745d11a441 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:35.447077 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-183de981-5efc-4736-87c5-5fb926ba30d6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:35.448093 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-183de981-5efc-4736-87c5-5fb926ba30d6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:35.475908 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-183de981-5efc-4736-87c5-5fb926ba30d6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:35.476494 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-183de981-5efc-4736-87c5-5fb926ba30d6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:35.476929 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-183de981-5efc-4736-87c5-5fb926ba30d6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:35.490059 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-183de981-5efc-4736-87c5-5fb926ba30d6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:35.490684 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-183de981-5efc-4736-87c5-5fb926ba30d6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:35.491121 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-183de981-5efc-4736-87c5-5fb926ba30d6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:35.666520 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell0:SELECT=2 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:29:35.923385 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell0:SELECT=8 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:29:36.089502 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-a4b0a7f8-ed73-4c84-bacd-03745d11a441 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:36.105769 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-a4b0a7f8-ed73-4c84-bacd-03745d11a441 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.789418 Aug 12 01:29:36.107687 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 98/201] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:35 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:36.128637 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-cb990c6d-1a5d-4f1d-931e-11b1adf8b18b req-851ae9f2-d605-4cdd-92bf-2ddc76dd3f26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32538820-dcc6-45ce-9b8b-dea8fe7e4776", "tag": "2fdb5157-5165-4135-b58d-b3f4cc47979a"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:29:36.149544 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-cb990c6d-1a5d-4f1d-931e-11b1adf8b18b req-851ae9f2-d605-4cdd-92bf-2ddc76dd3f26 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:36.150004 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-cb990c6d-1a5d-4f1d-931e-11b1adf8b18b req-851ae9f2-d605-4cdd-92bf-2ddc76dd3f26 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:36.150424 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-cb990c6d-1a5d-4f1d-931e-11b1adf8b18b req-851ae9f2-d605-4cdd-92bf-2ddc76dd3f26 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:36.171085 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-cb990c6d-1a5d-4f1d-931e-11b1adf8b18b req-851ae9f2-d605-4cdd-92bf-2ddc76dd3f26 service nova] Creating event network-changed:2fdb5157-5165-4135-b58d-b3f4cc47979a for instance 32538820-dcc6-45ce-9b8b-dea8fe7e4776 on hv-cinder-78481 Aug 12 01:29:36.212470 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-cb990c6d-1a5d-4f1d-931e-11b1adf8b18b req-851ae9f2-d605-4cdd-92bf-2ddc76dd3f26 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102967 Aug 12 01:29:36.213484 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 99/202] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:29:36.229485 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-183de981-5efc-4736-87c5-5fb926ba30d6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:36.244501 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-183de981-5efc-4736-87c5-5fb926ba30d6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1359 microversion: 2.1 time: 0.802750 Aug 12 01:29:36.249305 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 104/203] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:35 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1359 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:37.130476 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-2952aada-8539-4c3c-9c02-b686798a8144 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:37.131501 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-2952aada-8539-4c3c-9c02-b686798a8144 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:37.143943 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2952aada-8539-4c3c-9c02-b686798a8144 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:37.144712 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2952aada-8539-4c3c-9c02-b686798a8144 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:37.145131 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2952aada-8539-4c3c-9c02-b686798a8144 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:37.145843 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2952aada-8539-4c3c-9c02-b686798a8144 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:37.146286 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2952aada-8539-4c3c-9c02-b686798a8144 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:37.146703 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2952aada-8539-4c3c-9c02-b686798a8144 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:37.274283 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-9718ca18-6e46-48d8-adf9-8824506ac412 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:37.275738 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-9718ca18-6e46-48d8-adf9-8824506ac412 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:37.286880 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9718ca18-6e46-48d8-adf9-8824506ac412 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:37.288645 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9718ca18-6e46-48d8-adf9-8824506ac412 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:37.290783 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9718ca18-6e46-48d8-adf9-8824506ac412 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:37.292580 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9718ca18-6e46-48d8-adf9-8824506ac412 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:37.294982 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9718ca18-6e46-48d8-adf9-8824506ac412 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:37.295880 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9718ca18-6e46-48d8-adf9-8824506ac412 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:37.600388 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-9718ca18-6e46-48d8-adf9-8824506ac412 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:37.619243 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-9718ca18-6e46-48d8-adf9-8824506ac412 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1359 microversion: 2.1 time: 0.349473 Aug 12 01:29:37.621841 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 105/204] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:37 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1359 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:37.626798 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-2952aada-8539-4c3c-9c02-b686798a8144 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:37.638580 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-2952aada-8539-4c3c-9c02-b686798a8144 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.514203 Aug 12 01:29:37.654664 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 100/205] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:37 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:38.662978 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-e22e3b71-549b-43c7-a6c6-df9bca3f9fbe tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:38.664441 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-e22e3b71-549b-43c7-a6c6-df9bca3f9fbe tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:38.673826 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:29:38.677188 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e22e3b71-549b-43c7-a6c6-df9bca3f9fbe tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:38.679439 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e22e3b71-549b-43c7-a6c6-df9bca3f9fbe tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:38.681076 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e22e3b71-549b-43c7-a6c6-df9bca3f9fbe tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:38.683606 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e22e3b71-549b-43c7-a6c6-df9bca3f9fbe tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:38.685291 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e22e3b71-549b-43c7-a6c6-df9bca3f9fbe tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:38.687036 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e22e3b71-549b-43c7-a6c6-df9bca3f9fbe tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:38.776120 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-2d344682-03f2-464a-9a23-296ee3a504bf tempest-VolumesGetTestJSON-1477007247 tempest-VolumesGetTestJSON-1477007247-project] Action: 'create', calling method: .version_select at 0x7f2ded05f4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1641677256", "metadata": {"Type": "work"}}} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:29:39.134372 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-e22e3b71-549b-43c7-a6c6-df9bca3f9fbe tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:39.151558 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-e22e3b71-549b-43c7-a6c6-df9bca3f9fbe tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1359 microversion: 2.1 time: 0.497217 Aug 12 01:29:39.169965 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 101/206] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:38 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1359 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:39.189978 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-d9bfcb5e-9a9c-4c94-a8d2-2c328403b377 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:39.191514 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-d9bfcb5e-9a9c-4c94-a8d2-2c328403b377 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:39.200225 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d9bfcb5e-9a9c-4c94-a8d2-2c328403b377 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:39.200981 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d9bfcb5e-9a9c-4c94-a8d2-2c328403b377 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:39.201567 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d9bfcb5e-9a9c-4c94-a8d2-2c328403b377 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:39.202553 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d9bfcb5e-9a9c-4c94-a8d2-2c328403b377 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:39.203154 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d9bfcb5e-9a9c-4c94-a8d2-2c328403b377 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:39.212664 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d9bfcb5e-9a9c-4c94-a8d2-2c328403b377 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:39.638745 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-2d344682-03f2-464a-9a23-296ee3a504bf tempest-VolumesGetTestJSON-1477007247 tempest-VolumesGetTestJSON-1477007247-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.113327 Aug 12 01:29:39.639309 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 106/207] 10.222.0.20 () {60 vars in 1156 bytes} [Fri Aug 12 01:29:38 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1115 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 12 01:29:39.652572 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-0f491747-6a43-49dd-9ff9-3f4ac897b090 tempest-VolumesGetTestJSON-1477007247 tempest-VolumesGetTestJSON-1477007247-project] Calling method '.version_select at 0x7f2ded09eaf0>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:39.681539 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-d9bfcb5e-9a9c-4c94-a8d2-2c328403b377 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:39.691162 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-d9bfcb5e-9a9c-4c94-a8d2-2c328403b377 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.519650 Aug 12 01:29:39.691782 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 102/208] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:39 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:39.774157 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-0f491747-6a43-49dd-9ff9-3f4ac897b090 tempest-VolumesGetTestJSON-1477007247 tempest-VolumesGetTestJSON-1477007247-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/785c0e83-65a9-462d-ab17-98031f6365f4" status: 200 len: 353 microversion: 2.1 time: 0.126379 Aug 12 01:29:39.781575 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 107/209] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Aug 12 01:29:39 2022] GET /compute/v2.1/os-volumes/785c0e83-65a9-462d-ab17-98031f6365f4 => generated 353 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:29:40.186809 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-ee2c1aee-7aff-45fe-9927-f57ddf3025a9 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:40.187827 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-ee2c1aee-7aff-45fe-9927-f57ddf3025a9 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:40.205423 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ee2c1aee-7aff-45fe-9927-f57ddf3025a9 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:40.206210 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ee2c1aee-7aff-45fe-9927-f57ddf3025a9 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:40.206819 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ee2c1aee-7aff-45fe-9927-f57ddf3025a9 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:40.208174 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ee2c1aee-7aff-45fe-9927-f57ddf3025a9 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:40.209480 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ee2c1aee-7aff-45fe-9927-f57ddf3025a9 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:40.210305 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ee2c1aee-7aff-45fe-9927-f57ddf3025a9 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:40.488749 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-ee2c1aee-7aff-45fe-9927-f57ddf3025a9 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:40.496757 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-ee2c1aee-7aff-45fe-9927-f57ddf3025a9 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1359 microversion: 2.1 time: 0.313854 Aug 12 01:29:40.504196 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 103/210] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:40 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1359 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:40.712937 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-851c14f6-c195-4884-b23f-584734ec9f76 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:40.713542 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-851c14f6-c195-4884-b23f-584734ec9f76 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:40.727876 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-851c14f6-c195-4884-b23f-584734ec9f76 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:40.728360 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-851c14f6-c195-4884-b23f-584734ec9f76 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:40.728807 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-851c14f6-c195-4884-b23f-584734ec9f76 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:40.729490 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-851c14f6-c195-4884-b23f-584734ec9f76 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:40.729933 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-851c14f6-c195-4884-b23f-584734ec9f76 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:40.730347 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-851c14f6-c195-4884-b23f-584734ec9f76 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:40.790754 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-74e4ca71-c9fa-4cae-85b3-2bee32d6a779 tempest-VolumesGetTestJSON-1477007247 tempest-VolumesGetTestJSON-1477007247-project] Calling method '.version_select at 0x7f2ded218550>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:40.875282 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-74e4ca71-c9fa-4cae-85b3-2bee32d6a779 tempest-VolumesGetTestJSON-1477007247 tempest-VolumesGetTestJSON-1477007247-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/785c0e83-65a9-462d-ab17-98031f6365f4" status: 200 len: 354 microversion: 2.1 time: 0.089892 Aug 12 01:29:40.883919 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 104/211] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Aug 12 01:29:40 2022] GET /compute/v2.1/os-volumes/785c0e83-65a9-462d-ab17-98031f6365f4 => generated 354 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:29:40.971796 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-851c14f6-c195-4884-b23f-584734ec9f76 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:40.980714 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-851c14f6-c195-4884-b23f-584734ec9f76 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.272055 Aug 12 01:29:40.982203 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 108/212] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:40 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:40.987703 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-eeb9aed4-e536-4551-adfd-1fb4ef645780 tempest-VolumesGetTestJSON-1477007247 tempest-VolumesGetTestJSON-1477007247-project] Calling method '.version_select at 0x7f2ded05f310>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:41.045514 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-eeb9aed4-e536-4551-adfd-1fb4ef645780 tempest-VolumesGetTestJSON-1477007247 tempest-VolumesGetTestJSON-1477007247-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/785c0e83-65a9-462d-ab17-98031f6365f4" status: 200 len: 354 microversion: 2.1 time: 0.062084 Aug 12 01:29:41.047582 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 109/213] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Aug 12 01:29:40 2022] GET /compute/v2.1/os-volumes/785c0e83-65a9-462d-ab17-98031f6365f4 => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:29:41.065879 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-02c82edd-eb6d-4cff-b34e-479e981e5dc8 tempest-VolumesGetTestJSON-1477007247 tempest-VolumesGetTestJSON-1477007247-project] Calling method '.version_select at 0x7f2ded09edc0>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:41.126393 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-1c443d6f-9ffb-4059-81ca-c7055b4c810a tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Action: 'create', calling method: .version_select at 0x7f2decff89d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-140950627", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjrJX4n4hmJIPAtZw4Ib9DeKtRC09SJ4XwTa5+RsfIHEZf1GgBX6anFD+dMnDcjBVd5e/zVHBygLkCOYBRn9/DHQl4fh7UecJMHy5iWXa1CyVhVVarNuAPAgd6YYufeCA=="}} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:29:41.146671 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.quota [None req-1c443d6f-9ffb-4059-81ca-c7055b4c810a tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Getting quotas for project 2ca05e52a1c94aa7a8877ea34c412c95. Resources: {'key_pairs'} {{(pid=120785) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 01:29:41.152061 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.quota [None req-1c443d6f-9ffb-4059-81ca-c7055b4c810a tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Getting quotas for user 166e2f065c674cc0a6465f3d0d6bbb4d and project 2ca05e52a1c94aa7a8877ea34c412c95. Resources: {'key_pairs'} {{(pid=120785) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 01:29:41.154586 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-02c82edd-eb6d-4cff-b34e-479e981e5dc8 tempest-VolumesGetTestJSON-1477007247 tempest-VolumesGetTestJSON-1477007247-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/785c0e83-65a9-462d-ab17-98031f6365f4" status: 202 len: 0 microversion: 2.1 time: 0.092529 Aug 12 01:29:41.155154 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 110/214] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Aug 12 01:29:41 2022] DELETE /compute/v2.1/os-volumes/785c0e83-65a9-462d-ab17-98031f6365f4 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 01:29:41.163459 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-72f3b0dd-9534-4454-893c-3541ae548905 tempest-VolumesGetTestJSON-1477007247 tempest-VolumesGetTestJSON-1477007247-project] Calling method '.version_select at 0x7f2decfefca0>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:41.182046 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-1c443d6f-9ffb-4059-81ca-c7055b4c810a tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.296178 Aug 12 01:29:41.183598 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 105/215] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Aug 12 01:29:40 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:29:41.221547 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-72f3b0dd-9534-4454-893c-3541ae548905 tempest-VolumesGetTestJSON-1477007247 tempest-VolumesGetTestJSON-1477007247-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/785c0e83-65a9-462d-ab17-98031f6365f4" status: 200 len: 353 microversion: 2.1 time: 0.061655 Aug 12 01:29:41.222552 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 111/216] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Aug 12 01:29:41 2022] GET /compute/v2.1/os-volumes/785c0e83-65a9-462d-ab17-98031f6365f4 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 01:29:41.524738 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-71d980f1-cdd2-4d5f-9554-2e92c26d27e3 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:41.525568 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-71d980f1-cdd2-4d5f-9554-2e92c26d27e3 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:41.534271 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-71d980f1-cdd2-4d5f-9554-2e92c26d27e3 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:41.535083 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-71d980f1-cdd2-4d5f-9554-2e92c26d27e3 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:41.535871 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-71d980f1-cdd2-4d5f-9554-2e92c26d27e3 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:41.536757 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-71d980f1-cdd2-4d5f-9554-2e92c26d27e3 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:41.537468 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-71d980f1-cdd2-4d5f-9554-2e92c26d27e3 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:41.538387 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-71d980f1-cdd2-4d5f-9554-2e92c26d27e3 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:41.721675 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-71d980f1-cdd2-4d5f-9554-2e92c26d27e3 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:41.731341 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-71d980f1-cdd2-4d5f-9554-2e92c26d27e3 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1359 microversion: 2.1 time: 0.211565 Aug 12 01:29:41.732200 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 106/217] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:41 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:29:42.005622 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-4a171485-0c2e-42f4-9094-9c602544af11 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:42.006222 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-4a171485-0c2e-42f4-9094-9c602544af11 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:42.012418 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4a171485-0c2e-42f4-9094-9c602544af11 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:42.012906 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4a171485-0c2e-42f4-9094-9c602544af11 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:42.013336 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4a171485-0c2e-42f4-9094-9c602544af11 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:42.014035 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4a171485-0c2e-42f4-9094-9c602544af11 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:42.014486 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4a171485-0c2e-42f4-9094-9c602544af11 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:42.014904 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4a171485-0c2e-42f4-9094-9c602544af11 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:42.173343 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-4a171485-0c2e-42f4-9094-9c602544af11 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:42.184418 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-4a171485-0c2e-42f4-9094-9c602544af11 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.182969 Aug 12 01:29:42.185655 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 112/218] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:41 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:42.238017 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-9c41a8bc-9eef-4cd5-b698-0b3ae6525e11 tempest-VolumesGetTestJSON-1477007247 tempest-VolumesGetTestJSON-1477007247-project] Calling method '.version_select at 0x7f2ded15f1f0>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:42.277183 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.wsgi [None req-9c41a8bc-9eef-4cd5-b698-0b3ae6525e11 tempest-VolumesGetTestJSON-1477007247 tempest-VolumesGetTestJSON-1477007247-project] HTTP exception thrown: Volume 785c0e83-65a9-462d-ab17-98031f6365f4 could not be found. Aug 12 01:29:42.279209 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-9c41a8bc-9eef-4cd5-b698-0b3ae6525e11 tempest-VolumesGetTestJSON-1477007247 tempest-VolumesGetTestJSON-1477007247-project] Request method failure captured: Aug 12 01:29:42.279209 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: request: GET /compute/v2.1/os-volumes/785c0e83-65a9-462d-ab17-98031f6365f4 HTTP/1.1 Aug 12 01:29:42.279209 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept: application/json Aug 12 01:29:42.279209 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept-Encoding: identity Aug 12 01:29:42.279209 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Connection: close Aug 12 01:29:42.279209 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Length: 0 Aug 12 01:29:42.279209 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Type: application/json Aug 12 01:29:42.279209 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Host: 10.222.0.20 Aug 12 01:29:42.279209 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Openstack-System-Scope: None Aug 12 01:29:42.279209 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: User-Agent: python-urllib3/1.26.11 Aug 12 01:29:42.279209 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Auth-Token: gAAAAABi9a0C_Rb1WlKmljAI6rwalfaXv8JsHOMdyw7o2cVvWyexIU93OQMSKCsNQb2Yuetu_E8wAiXQrx8HSFIZ8KEg3n-cZ2MJ8Cv3EZDvU9tkwMGR0HZbKS16i5mTB2l_smS9cNeo8g52_L03L37iw6ubfQQ1soJjdqKICuXKGlznHJRvdas Aug 12 01:29:42.279209 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Id: None Aug 12 01:29:42.279209 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Name: None Aug 12 01:29:42.279209 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Identity-Status: Confirmed Aug 12 01:29:42.279209 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Is-Admin-Project: True Aug 12 01:29:42.279209 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Id: default Aug 12 01:29:42.279209 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Name: Default Aug 12 01:29:42.279209 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Id: ad80390c39e64df598ecf5b3642286de Aug 12 01:29:42.279209 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Name: tempest-VolumesGetTestJSON-1477007247 Aug 12 01:29:42.279209 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Role: member,reader Aug 12 01:29:42.279209 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Roles: member,reader Aug 12 01:29:42.280666 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ad80390c39e64df598ecf5b3642286de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ad80390c39e64df598ecf5b3642286de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ad80390c39e64df598ecf5b3642286de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ad80390c39e64df598ecf5b3642286de"}]}] Aug 12 01:29:42.280666 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant: tempest-VolumesGetTestJSON-1477007247 Aug 12 01:29:42.280666 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Id: ad80390c39e64df598ecf5b3642286de Aug 12 01:29:42.280666 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Name: tempest-VolumesGetTestJSON-1477007247 Aug 12 01:29:42.280666 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User: tempest-VolumesGetTestJSON-1477007247-project Aug 12 01:29:42.280666 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Id: default Aug 12 01:29:42.280666 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Name: Default Aug 12 01:29:42.280666 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Id: 6243d42d44c940c2a098ab110292ea8e Aug 12 01:29:42.280666 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Name: tempest-VolumesGetTestJSON-1477007247-project Aug 12 01:29:42.280666 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: method: Aug 12 01:29:42.280666 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: exception: Volume 785c0e83-65a9-462d-ab17-98031f6365f4 could not be found. Aug 12 01:29:42.280666 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: action_args: {'id': '785c0e83-65a9-462d-ab17-98031f6365f4'} Aug 12 01:29:42.280666 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:29:42.281558 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:29:42.281558 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 01:29:42.281558 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 01:29:42.281558 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 01:29:42.281558 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 01:29:42.281558 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 01:29:42.281558 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 01:29:42.281558 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 01:29:42.281558 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 01:29:42.281558 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 01:29:42.281558 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 01:29:42.281558 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 01:29:42.281558 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 01:29:42.281558 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 01:29:42.281558 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 01:29:42.281558 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 785c0e83-65a9-462d-ab17-98031f6365f4 could not be found. (HTTP 404) (Request-ID: req-feea25c3-6a97-4b78-823c-ae976c2791a3) Aug 12 01:29:42.281558 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:29:42.281558 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:29:42.281558 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:29:42.282832 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:29:42.282832 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 12 01:29:42.282832 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 12 01:29:42.282832 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 01:29:42.282832 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 01:29:42.282832 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 12 01:29:42.282832 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 12 01:29:42.282832 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 01:29:42.282832 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 01:29:42.282832 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 01:29:42.282832 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 01:29:42.282832 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 01:29:42.282832 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 01:29:42.282832 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 01:29:42.282832 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 01:29:42.282832 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 01:29:42.282832 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 01:29:42.282832 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 01:29:42.282832 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 01:29:42.284177 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 01:29:42.284177 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 01:29:42.284177 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 01:29:42.284177 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 01:29:42.284177 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 785c0e83-65a9-462d-ab17-98031f6365f4 could not be found. Aug 12 01:29:42.284177 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:29:42.284177 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:29:42.284177 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:29:42.284177 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:29:42.284177 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:29:42.284177 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:29:42.284177 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:29:42.284177 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:29:42.284177 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 01:29:42.284177 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 01:29:42.284177 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:29:42.284177 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:29:42.284177 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 12 01:29:42.284177 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:29:42.285389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 785c0e83-65a9-462d-ab17-98031f6365f4 could not be found. Aug 12 01:29:42.285389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:29:42.285389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:29:42.285389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:29:42.285389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:29:42.285389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:29:42.285389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:29:42.285389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:29:42.285389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:29:42.285389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 785c0e83-65a9-462d-ab17-98031f6365f4 could not be found. Aug 12 01:29:42.285389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:29:42.285389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-9c41a8bc-9eef-4cd5-b698-0b3ae6525e11 tempest-VolumesGetTestJSON-1477007247 tempest-VolumesGetTestJSON-1477007247-project] Returning 404 to user: Volume 785c0e83-65a9-462d-ab17-98031f6365f4 could not be found. {{(pid=120785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:29:42.285389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-9c41a8bc-9eef-4cd5-b698-0b3ae6525e11 tempest-VolumesGetTestJSON-1477007247 tempest-VolumesGetTestJSON-1477007247-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/785c0e83-65a9-462d-ab17-98031f6365f4" status: 404 len: 109 microversion: 2.1 time: 0.048734 Aug 12 01:29:42.285389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 107/219] 10.222.0.20 () {58 vars in 1245 bytes} [Fri Aug 12 01:29:42 2022] GET /compute/v2.1/os-volumes/785c0e83-65a9-462d-ab17-98031f6365f4 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:29:42.755239 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-3d5654b8-71ad-4121-9301-9ae4dab6495b tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:42.756072 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-3d5654b8-71ad-4121-9301-9ae4dab6495b tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:42.763180 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3d5654b8-71ad-4121-9301-9ae4dab6495b tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:42.763691 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3d5654b8-71ad-4121-9301-9ae4dab6495b tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:42.764114 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3d5654b8-71ad-4121-9301-9ae4dab6495b tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:42.764794 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3d5654b8-71ad-4121-9301-9ae4dab6495b tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:42.765432 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3d5654b8-71ad-4121-9301-9ae4dab6495b tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:42.765986 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3d5654b8-71ad-4121-9301-9ae4dab6495b tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:43.001011 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-3d5654b8-71ad-4121-9301-9ae4dab6495b tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:43.018444 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-3d5654b8-71ad-4121-9301-9ae4dab6495b tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1359 microversion: 2.1 time: 0.266710 Aug 12 01:29:43.021080 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 113/220] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:42 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1359 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:43.206402 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-7862bbcb-266d-41a2-b818-a65b09c8b470 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:43.207189 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-7862bbcb-266d-41a2-b818-a65b09c8b470 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:43.216509 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7862bbcb-266d-41a2-b818-a65b09c8b470 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:43.217352 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7862bbcb-266d-41a2-b818-a65b09c8b470 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:43.218003 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7862bbcb-266d-41a2-b818-a65b09c8b470 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:43.219082 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7862bbcb-266d-41a2-b818-a65b09c8b470 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:43.219788 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7862bbcb-266d-41a2-b818-a65b09c8b470 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:43.220450 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7862bbcb-266d-41a2-b818-a65b09c8b470 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:43.380725 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-7862bbcb-266d-41a2-b818-a65b09c8b470 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:43.389815 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-7862bbcb-266d-41a2-b818-a65b09c8b470 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.187607 Aug 12 01:29:43.406536 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 108/221] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:43 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:29:44.046594 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-8e88abc6-ec00-469a-b1c8-e39e1572f916 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:44.048262 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-8e88abc6-ec00-469a-b1c8-e39e1572f916 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:44.054246 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8e88abc6-ec00-469a-b1c8-e39e1572f916 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:44.054723 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8e88abc6-ec00-469a-b1c8-e39e1572f916 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:44.055153 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8e88abc6-ec00-469a-b1c8-e39e1572f916 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:44.056395 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8e88abc6-ec00-469a-b1c8-e39e1572f916 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:44.057266 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8e88abc6-ec00-469a-b1c8-e39e1572f916 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:44.057911 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8e88abc6-ec00-469a-b1c8-e39e1572f916 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:44.218501 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-8e88abc6-ec00-469a-b1c8-e39e1572f916 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:44.236876 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-8e88abc6-ec00-469a-b1c8-e39e1572f916 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1359 microversion: 2.1 time: 0.198710 Aug 12 01:29:44.240486 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 114/222] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:44 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1359 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:44.414004 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-cb4d4933-cc52-4bfc-a394-248427f37a23 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:44.414739 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-cb4d4933-cc52-4bfc-a394-248427f37a23 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:44.432493 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cb4d4933-cc52-4bfc-a394-248427f37a23 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:44.433200 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cb4d4933-cc52-4bfc-a394-248427f37a23 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:44.433717 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cb4d4933-cc52-4bfc-a394-248427f37a23 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:44.434484 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cb4d4933-cc52-4bfc-a394-248427f37a23 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:44.434951 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cb4d4933-cc52-4bfc-a394-248427f37a23 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:44.435372 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cb4d4933-cc52-4bfc-a394-248427f37a23 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:44.674869 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-cb4d4933-cc52-4bfc-a394-248427f37a23 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:44.687511 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-cb4d4933-cc52-4bfc-a394-248427f37a23 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1521 microversion: 2.1 time: 0.276936 Aug 12 01:29:44.695584 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 109/223] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:44 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:45.260633 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-9dca89e5-4101-488c-a032-d02ee65b4f58 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:45.261315 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-9dca89e5-4101-488c-a032-d02ee65b4f58 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:45.267938 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9dca89e5-4101-488c-a032-d02ee65b4f58 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:45.268509 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9dca89e5-4101-488c-a032-d02ee65b4f58 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:45.268946 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9dca89e5-4101-488c-a032-d02ee65b4f58 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:45.269625 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9dca89e5-4101-488c-a032-d02ee65b4f58 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:45.270073 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9dca89e5-4101-488c-a032-d02ee65b4f58 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:45.270492 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9dca89e5-4101-488c-a032-d02ee65b4f58 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:45.414578 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-9dca89e5-4101-488c-a032-d02ee65b4f58 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:45.422886 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-9dca89e5-4101-488c-a032-d02ee65b4f58 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1359 microversion: 2.1 time: 0.165946 Aug 12 01:29:45.423850 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 115/224] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:45 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:45.711221 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-9eae031f-857f-4802-a080-476bd53d1370 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:45.711858 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-9eae031f-857f-4802-a080-476bd53d1370 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:45.728145 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9eae031f-857f-4802-a080-476bd53d1370 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:45.728668 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9eae031f-857f-4802-a080-476bd53d1370 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:45.729115 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9eae031f-857f-4802-a080-476bd53d1370 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:45.729829 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9eae031f-857f-4802-a080-476bd53d1370 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:45.730281 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9eae031f-857f-4802-a080-476bd53d1370 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:45.730702 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9eae031f-857f-4802-a080-476bd53d1370 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:46.124318 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-9eae031f-857f-4802-a080-476bd53d1370 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:46.139011 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-9eae031f-857f-4802-a080-476bd53d1370 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1501 microversion: 2.1 time: 0.431767 Aug 12 01:29:46.139599 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 110/225] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:45 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1501 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:46.160309 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-fc553e27-3a32-4217-a9c4-6d7606a9fc90 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:46.164940 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-fc553e27-3a32-4217-a9c4-6d7606a9fc90 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 1e1a8df3-8078-437c-ab98-64d52e277263] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:46.171431 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fc553e27-3a32-4217-a9c4-6d7606a9fc90 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:46.172066 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fc553e27-3a32-4217-a9c4-6d7606a9fc90 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:46.172632 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fc553e27-3a32-4217-a9c4-6d7606a9fc90 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:46.173325 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fc553e27-3a32-4217-a9c4-6d7606a9fc90 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:46.173844 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fc553e27-3a32-4217-a9c4-6d7606a9fc90 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:46.174330 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fc553e27-3a32-4217-a9c4-6d7606a9fc90 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:46.386634 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-fc553e27-3a32-4217-a9c4-6d7606a9fc90 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:46.398368 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-fc553e27-3a32-4217-a9c4-6d7606a9fc90 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263" status: 200 len: 1515 microversion: 2.1 time: 0.242021 Aug 12 01:29:46.399355 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 116/226] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:46 2022] GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263 => generated 1515 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:46.445286 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-aab7714d-cb09-4736-98ec-2d78e6c8d768 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:46.445999 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-aab7714d-cb09-4736-98ec-2d78e6c8d768 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:46.452444 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-aab7714d-cb09-4736-98ec-2d78e6c8d768 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:46.453007 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-aab7714d-cb09-4736-98ec-2d78e6c8d768 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:46.453514 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-aab7714d-cb09-4736-98ec-2d78e6c8d768 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:46.454558 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-aab7714d-cb09-4736-98ec-2d78e6c8d768 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:46.455414 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-aab7714d-cb09-4736-98ec-2d78e6c8d768 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:46.456575 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-aab7714d-cb09-4736-98ec-2d78e6c8d768 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:46.623100 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-aab7714d-cb09-4736-98ec-2d78e6c8d768 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:46.631032 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-aab7714d-cb09-4736-98ec-2d78e6c8d768 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1359 microversion: 2.1 time: 0.189541 Aug 12 01:29:46.631635 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 111/227] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:46 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:47.653139 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-a8ac8544-04b7-40b8-99a5-c6a28ff56a94 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:47.653824 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-a8ac8544-04b7-40b8-99a5-c6a28ff56a94 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:47.660653 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a8ac8544-04b7-40b8-99a5-c6a28ff56a94 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:47.661188 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a8ac8544-04b7-40b8-99a5-c6a28ff56a94 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:47.661767 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a8ac8544-04b7-40b8-99a5-c6a28ff56a94 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:47.662514 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a8ac8544-04b7-40b8-99a5-c6a28ff56a94 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:47.662965 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a8ac8544-04b7-40b8-99a5-c6a28ff56a94 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:47.663391 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a8ac8544-04b7-40b8-99a5-c6a28ff56a94 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:47.797159 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-a8ac8544-04b7-40b8-99a5-c6a28ff56a94 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:47.804831 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-a8ac8544-04b7-40b8-99a5-c6a28ff56a94 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1359 microversion: 2.1 time: 0.155559 Aug 12 01:29:47.806168 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 117/228] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:47 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:47.840554 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-cd5a5962-96b8-483a-83ed-940887e228f6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:29:47.842916 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-cd5a5962-96b8-483a-83ed-940887e228f6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 1e1a8df3-8078-437c-ab98-64d52e277263] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:47.850659 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cd5a5962-96b8-483a-83ed-940887e228f6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:47.851142 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cd5a5962-96b8-483a-83ed-940887e228f6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:47.851580 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cd5a5962-96b8-483a-83ed-940887e228f6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:47.852267 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cd5a5962-96b8-483a-83ed-940887e228f6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:47.852704 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cd5a5962-96b8-483a-83ed-940887e228f6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:47.853110 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cd5a5962-96b8-483a-83ed-940887e228f6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:47.879580 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.objects.instance [None req-cd5a5962-96b8-483a-83ed-940887e228f6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lazy-loading 'flavor' on Instance uuid 1e1a8df3-8078-437c-ab98-64d52e277263 {{(pid=120785) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 01:29:47.946747 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:29:47.957339 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-cd5a5962-96b8-483a-83ed-940887e228f6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "POST /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263/action" status: 200 len: 32 microversion: 2.1 time: 0.120930 Aug 12 01:29:47.958063 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 112/229] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Aug 12 01:29:47 2022] POST /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263/action => generated 32 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 01:29:47.968722 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-305fb340-5b33-4b32-95f5-019bd5b9a361 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:47.970474 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-305fb340-5b33-4b32-95f5-019bd5b9a361 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 1e1a8df3-8078-437c-ab98-64d52e277263] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:47.982532 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-305fb340-5b33-4b32-95f5-019bd5b9a361 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:47.983830 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-305fb340-5b33-4b32-95f5-019bd5b9a361 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:47.984328 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-305fb340-5b33-4b32-95f5-019bd5b9a361 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:47.985188 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-305fb340-5b33-4b32-95f5-019bd5b9a361 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:47.985663 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-305fb340-5b33-4b32-95f5-019bd5b9a361 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:47.986129 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-305fb340-5b33-4b32-95f5-019bd5b9a361 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:48.140087 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-305fb340-5b33-4b32-95f5-019bd5b9a361 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:48.148143 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-305fb340-5b33-4b32-95f5-019bd5b9a361 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263" status: 200 len: 1521 microversion: 2.1 time: 0.184080 Aug 12 01:29:48.149046 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 118/230] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:47 2022] GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:48.827378 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-2221dc6c-774a-4830-a906-7468e21068bf tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:48.828488 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-2221dc6c-774a-4830-a906-7468e21068bf tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:48.839732 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2221dc6c-774a-4830-a906-7468e21068bf tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:48.840445 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2221dc6c-774a-4830-a906-7468e21068bf tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:48.841278 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2221dc6c-774a-4830-a906-7468e21068bf tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:48.842192 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2221dc6c-774a-4830-a906-7468e21068bf tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:48.842794 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2221dc6c-774a-4830-a906-7468e21068bf tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:48.843353 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2221dc6c-774a-4830-a906-7468e21068bf tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:48.998015 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-2221dc6c-774a-4830-a906-7468e21068bf tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:49.005666 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-2221dc6c-774a-4830-a906-7468e21068bf tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1359 microversion: 2.1 time: 0.183005 Aug 12 01:29:49.006200 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 113/231] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:48 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:49.174338 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-942fd5a0-baec-4b2c-b680-1341a3f1a9ee tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:49.174925 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-942fd5a0-baec-4b2c-b680-1341a3f1a9ee tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 1e1a8df3-8078-437c-ab98-64d52e277263] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:49.182286 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-942fd5a0-baec-4b2c-b680-1341a3f1a9ee tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:49.182773 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-942fd5a0-baec-4b2c-b680-1341a3f1a9ee tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:49.183209 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-942fd5a0-baec-4b2c-b680-1341a3f1a9ee tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:49.183961 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-942fd5a0-baec-4b2c-b680-1341a3f1a9ee tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:49.184403 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-942fd5a0-baec-4b2c-b680-1341a3f1a9ee tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:49.184854 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-942fd5a0-baec-4b2c-b680-1341a3f1a9ee tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:49.325736 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-942fd5a0-baec-4b2c-b680-1341a3f1a9ee tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:49.334428 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-942fd5a0-baec-4b2c-b680-1341a3f1a9ee tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263" status: 200 len: 1521 microversion: 2.1 time: 0.163969 Aug 12 01:29:49.334988 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 119/232] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:49 2022] GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:50.028159 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-c7765b5a-5c76-4d70-b77a-922a8e216a4b tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:50.029054 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-c7765b5a-5c76-4d70-b77a-922a8e216a4b tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:50.036597 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c7765b5a-5c76-4d70-b77a-922a8e216a4b tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:50.037078 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c7765b5a-5c76-4d70-b77a-922a8e216a4b tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:50.037497 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c7765b5a-5c76-4d70-b77a-922a8e216a4b tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:50.038195 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c7765b5a-5c76-4d70-b77a-922a8e216a4b tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:50.038634 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c7765b5a-5c76-4d70-b77a-922a8e216a4b tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:50.039048 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c7765b5a-5c76-4d70-b77a-922a8e216a4b tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:50.177923 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-c7765b5a-5c76-4d70-b77a-922a8e216a4b tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:50.186915 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-c7765b5a-5c76-4d70-b77a-922a8e216a4b tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1359 microversion: 2.1 time: 0.163552 Aug 12 01:29:50.187519 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 114/233] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:50 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:50.354759 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-d94f1029-3490-45c0-85db-baab3a2537ad tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:50.355581 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-d94f1029-3490-45c0-85db-baab3a2537ad tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 1e1a8df3-8078-437c-ab98-64d52e277263] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:50.362512 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d94f1029-3490-45c0-85db-baab3a2537ad tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:50.363038 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d94f1029-3490-45c0-85db-baab3a2537ad tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:50.363477 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d94f1029-3490-45c0-85db-baab3a2537ad tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:50.364241 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d94f1029-3490-45c0-85db-baab3a2537ad tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:50.364679 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d94f1029-3490-45c0-85db-baab3a2537ad tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:50.365091 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d94f1029-3490-45c0-85db-baab3a2537ad tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:50.509024 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-d94f1029-3490-45c0-85db-baab3a2537ad tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:50.516775 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-d94f1029-3490-45c0-85db-baab3a2537ad tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263" status: 200 len: 1521 microversion: 2.1 time: 0.165934 Aug 12 01:29:50.517408 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 120/234] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:50 2022] GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:50.856807 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-e08b7283-080d-4739-803a-36b8406ddf1d req-e0dd55ca-5ae3-4d62-b65d-8369677c89eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32538820-dcc6-45ce-9b8b-dea8fe7e4776", "name": "network-vif-plugged", "status": "completed", "tag": "2fdb5157-5165-4135-b58d-b3f4cc47979a"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:29:50.868232 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-e08b7283-080d-4739-803a-36b8406ddf1d req-e0dd55ca-5ae3-4d62-b65d-8369677c89eb service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:50.868707 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-e08b7283-080d-4739-803a-36b8406ddf1d req-e0dd55ca-5ae3-4d62-b65d-8369677c89eb service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:50.869295 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-e08b7283-080d-4739-803a-36b8406ddf1d req-e0dd55ca-5ae3-4d62-b65d-8369677c89eb service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:50.881877 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-e08b7283-080d-4739-803a-36b8406ddf1d req-e0dd55ca-5ae3-4d62-b65d-8369677c89eb service nova] Creating event network-vif-plugged:2fdb5157-5165-4135-b58d-b3f4cc47979a for instance 32538820-dcc6-45ce-9b8b-dea8fe7e4776 on hv-cinder-78481 Aug 12 01:29:50.886968 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-e08b7283-080d-4739-803a-36b8406ddf1d req-e0dd55ca-5ae3-4d62-b65d-8369677c89eb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034001 Aug 12 01:29:50.887614 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 115/235] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:29:51.213525 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-8b0ced19-bec1-4013-a665-8c52c047631b tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:51.214128 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-8b0ced19-bec1-4013-a665-8c52c047631b tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:51.223496 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8b0ced19-bec1-4013-a665-8c52c047631b tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:51.224023 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8b0ced19-bec1-4013-a665-8c52c047631b tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:51.224478 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8b0ced19-bec1-4013-a665-8c52c047631b tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:51.225163 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8b0ced19-bec1-4013-a665-8c52c047631b tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:51.225612 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8b0ced19-bec1-4013-a665-8c52c047631b tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:51.226027 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8b0ced19-bec1-4013-a665-8c52c047631b tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:51.367310 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-8b0ced19-bec1-4013-a665-8c52c047631b tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:51.375151 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-8b0ced19-bec1-4013-a665-8c52c047631b tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1359 microversion: 2.1 time: 0.165596 Aug 12 01:29:51.375767 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 121/236] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:51 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:51.430935 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-3d4aa357-9f7c-425f-becb-5223e77654ec tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:51.431520 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-3d4aa357-9f7c-425f-becb-5223e77654ec tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:51.433474 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell0:SELECT=4 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:29:51.441050 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3d4aa357-9f7c-425f-becb-5223e77654ec tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:51.441520 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3d4aa357-9f7c-425f-becb-5223e77654ec tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:51.441945 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3d4aa357-9f7c-425f-becb-5223e77654ec tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:51.442621 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3d4aa357-9f7c-425f-becb-5223e77654ec tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:51.443061 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3d4aa357-9f7c-425f-becb-5223e77654ec tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:51.443471 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3d4aa357-9f7c-425f-becb-5223e77654ec tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:51.468966 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-3d4aa357-9f7c-425f-becb-5223e77654ec tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a/ips" status: 200 len: 144 microversion: 2.1 time: 0.042561 Aug 12 01:29:51.469525 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 116/237] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Aug 12 01:29:51 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a/ips => generated 144 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:29:51.537834 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-c5de7d75-f84a-4ceb-ae49-f78b45cb3095 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:51.538449 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-c5de7d75-f84a-4ceb-ae49-f78b45cb3095 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 1e1a8df3-8078-437c-ab98-64d52e277263] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:51.544781 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c5de7d75-f84a-4ceb-ae49-f78b45cb3095 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:51.545267 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c5de7d75-f84a-4ceb-ae49-f78b45cb3095 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:51.545684 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c5de7d75-f84a-4ceb-ae49-f78b45cb3095 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:51.547283 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c5de7d75-f84a-4ceb-ae49-f78b45cb3095 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:51.547283 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c5de7d75-f84a-4ceb-ae49-f78b45cb3095 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:51.547283 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c5de7d75-f84a-4ceb-ae49-f78b45cb3095 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:51.685524 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-c5de7d75-f84a-4ceb-ae49-f78b45cb3095 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:51.693393 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-c5de7d75-f84a-4ceb-ae49-f78b45cb3095 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263" status: 200 len: 1521 microversion: 2.1 time: 0.159551 Aug 12 01:29:51.693943 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 122/238] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:51 2022] GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:52.395903 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-abcc6eec-1577-4d32-9065-d66b1f647b69 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:52.396533 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-abcc6eec-1577-4d32-9065-d66b1f647b69 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:52.403212 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-abcc6eec-1577-4d32-9065-d66b1f647b69 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:52.403806 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-abcc6eec-1577-4d32-9065-d66b1f647b69 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:52.404158 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-abcc6eec-1577-4d32-9065-d66b1f647b69 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:52.405020 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-abcc6eec-1577-4d32-9065-d66b1f647b69 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:52.405474 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-abcc6eec-1577-4d32-9065-d66b1f647b69 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:52.405892 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-abcc6eec-1577-4d32-9065-d66b1f647b69 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:52.443230 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-0ccafdc6-a3cc-4948-967a-969c8f600b17 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:52.444090 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-0ccafdc6-a3cc-4948-967a-969c8f600b17 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:52.450383 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0ccafdc6-a3cc-4948-967a-969c8f600b17 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:52.451136 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0ccafdc6-a3cc-4948-967a-969c8f600b17 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:52.451624 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0ccafdc6-a3cc-4948-967a-969c8f600b17 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:52.452608 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0ccafdc6-a3cc-4948-967a-969c8f600b17 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:52.453036 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0ccafdc6-a3cc-4948-967a-969c8f600b17 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:52.453447 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0ccafdc6-a3cc-4948-967a-969c8f600b17 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:52.458502 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell1:SELECT=100 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:29:52.480074 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-0ccafdc6-a3cc-4948-967a-969c8f600b17 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9/ips" status: 200 len: 151 microversion: 2.1 time: 0.043999 Aug 12 01:29:52.487276 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 123/239] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Aug 12 01:29:52 2022] GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9/ips => generated 151 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 01:29:52.570967 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-abcc6eec-1577-4d32-9065-d66b1f647b69 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:52.581452 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-abcc6eec-1577-4d32-9065-d66b1f647b69 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1359 microversion: 2.1 time: 0.189548 Aug 12 01:29:52.582029 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 117/240] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:52 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:52.714879 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-bc9cccd0-0cd1-4f5b-837a-1f05eb6c95a6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:52.715452 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-bc9cccd0-0cd1-4f5b-837a-1f05eb6c95a6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 1e1a8df3-8078-437c-ab98-64d52e277263] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:52.722428 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-bc9cccd0-0cd1-4f5b-837a-1f05eb6c95a6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:52.722901 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-bc9cccd0-0cd1-4f5b-837a-1f05eb6c95a6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:52.723515 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-bc9cccd0-0cd1-4f5b-837a-1f05eb6c95a6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:52.724238 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-bc9cccd0-0cd1-4f5b-837a-1f05eb6c95a6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:52.724813 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-bc9cccd0-0cd1-4f5b-837a-1f05eb6c95a6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:52.725407 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-bc9cccd0-0cd1-4f5b-837a-1f05eb6c95a6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:52.790511 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-41801492-4e44-48b5-9cd6-85d0d264c387 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:52.791059 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-41801492-4e44-48b5-9cd6-85d0d264c387 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:52.798329 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-41801492-4e44-48b5-9cd6-85d0d264c387 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:52.799124 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-41801492-4e44-48b5-9cd6-85d0d264c387 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:52.799719 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-41801492-4e44-48b5-9cd6-85d0d264c387 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:52.800578 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-41801492-4e44-48b5-9cd6-85d0d264c387 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:52.801169 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-41801492-4e44-48b5-9cd6-85d0d264c387 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:52.801737 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-41801492-4e44-48b5-9cd6-85d0d264c387 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:52.832326 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-41801492-4e44-48b5-9cd6-85d0d264c387 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8/ips" status: 200 len: 153 microversion: 2.20 time: 0.043973 Aug 12 01:29:52.833512 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 118/241] 10.222.0.20 () {60 vars in 1289 bytes} [Fri Aug 12 01:29:52 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8/ips => generated 153 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 12 01:29:52.943441 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-bc9cccd0-0cd1-4f5b-837a-1f05eb6c95a6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:52.951744 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-bc9cccd0-0cd1-4f5b-837a-1f05eb6c95a6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263" status: 200 len: 1521 microversion: 2.1 time: 0.241346 Aug 12 01:29:52.952331 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 124/242] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:52 2022] GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:53.606819 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-ee8990fc-b38e-4e91-902b-235713880c2e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:53.607401 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-ee8990fc-b38e-4e91-902b-235713880c2e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:53.613940 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ee8990fc-b38e-4e91-902b-235713880c2e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:53.614433 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ee8990fc-b38e-4e91-902b-235713880c2e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:53.614846 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ee8990fc-b38e-4e91-902b-235713880c2e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:53.615563 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ee8990fc-b38e-4e91-902b-235713880c2e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:53.627583 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ee8990fc-b38e-4e91-902b-235713880c2e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:53.627583 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ee8990fc-b38e-4e91-902b-235713880c2e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:53.762407 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-ee8990fc-b38e-4e91-902b-235713880c2e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:53.770834 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-ee8990fc-b38e-4e91-902b-235713880c2e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1548 microversion: 2.1 time: 0.167845 Aug 12 01:29:53.771399 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 119/243] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:53 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1548 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:53.792173 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-f2544d7e-45a3-4a81-b2a6-415a9ef3cf2e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:53.793026 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-f2544d7e-45a3-4a81-b2a6-415a9ef3cf2e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:53.800078 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f2544d7e-45a3-4a81-b2a6-415a9ef3cf2e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:53.800583 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f2544d7e-45a3-4a81-b2a6-415a9ef3cf2e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:53.801011 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f2544d7e-45a3-4a81-b2a6-415a9ef3cf2e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:53.801702 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f2544d7e-45a3-4a81-b2a6-415a9ef3cf2e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:53.802145 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f2544d7e-45a3-4a81-b2a6-415a9ef3cf2e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:53.802553 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f2544d7e-45a3-4a81-b2a6-415a9ef3cf2e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:53.938450 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-ccd12ce7-b8ac-4765-9ded-c3048349ea50 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6108d5df-c35c-45a0-ab30-da331c855b78"}} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:29:53.941187 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-ccd12ce7-b8ac-4765-9ded-c3048349ea50 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:53.948029 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ccd12ce7-b8ac-4765-9ded-c3048349ea50 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:53.948705 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ccd12ce7-b8ac-4765-9ded-c3048349ea50 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:53.949332 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ccd12ce7-b8ac-4765-9ded-c3048349ea50 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:53.950231 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ccd12ce7-b8ac-4765-9ded-c3048349ea50 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:53.952074 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ccd12ce7-b8ac-4765-9ded-c3048349ea50 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:53.952719 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ccd12ce7-b8ac-4765-9ded-c3048349ea50 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:53.960382 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-f2544d7e-45a3-4a81-b2a6-415a9ef3cf2e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:53.970664 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-f2544d7e-45a3-4a81-b2a6-415a9ef3cf2e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1548 microversion: 2.1 time: 0.182235 Aug 12 01:29:53.971329 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 125/244] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:53 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1548 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:29:53.975959 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-4be9c354-06af-48cf-a1b3-8c62367997fe tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:53.976557 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-4be9c354-06af-48cf-a1b3-8c62367997fe tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 1e1a8df3-8078-437c-ab98-64d52e277263] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:53.982686 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4be9c354-06af-48cf-a1b3-8c62367997fe tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:53.983161 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4be9c354-06af-48cf-a1b3-8c62367997fe tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:53.983813 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4be9c354-06af-48cf-a1b3-8c62367997fe tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:53.984781 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4be9c354-06af-48cf-a1b3-8c62367997fe tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:53.985466 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4be9c354-06af-48cf-a1b3-8c62367997fe tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:53.985886 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4be9c354-06af-48cf-a1b3-8c62367997fe tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:54.136631 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-4be9c354-06af-48cf-a1b3-8c62367997fe tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:54.144591 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-4be9c354-06af-48cf-a1b3-8c62367997fe tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263" status: 200 len: 1521 microversion: 2.1 time: 0.172243 Aug 12 01:29:54.145474 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 126/245] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:53 2022] GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:54.150032 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-7fac57ef-9f88-47e7-98cb-fcc455f8737e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:54.154725 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-7fac57ef-9f88-47e7-98cb-fcc455f8737e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:54.155380 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-7fac57ef-9f88-47e7-98cb-fcc455f8737e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Searching by: {'deleted': False, 'project_id': '135531dcbc244552aef21e5d555da3c4'} {{(pid=120786) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 12 01:29:54.162144 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7fac57ef-9f88-47e7-98cb-fcc455f8737e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:54.162727 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7fac57ef-9f88-47e7-98cb-fcc455f8737e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:54.163158 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7fac57ef-9f88-47e7-98cb-fcc455f8737e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:54.163890 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7fac57ef-9f88-47e7-98cb-fcc455f8737e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:54.164489 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7fac57ef-9f88-47e7-98cb-fcc455f8737e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:54.165076 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7fac57ef-9f88-47e7-98cb-fcc455f8737e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:54.275378 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.multi_cell_list [None req-7fac57ef-9f88-47e7-98cb-fcc455f8737e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120786) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 12 01:29:54.277531 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-ccd12ce7-b8ac-4765-9ded-c3048349ea50 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "POST /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.343434 Aug 12 01:29:54.280117 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 120/246] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Aug 12 01:29:53 2022] POST /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9/os-volume_attachments => generated 194 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:29:54.545307 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-7fac57ef-9f88-47e7-98cb-fcc455f8737e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.398579 Aug 12 01:29:54.545893 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 127/247] 10.222.0.20 () {58 vars in 1125 bytes} [Fri Aug 12 01:29:54 2022] GET /compute/v2.1/servers => generated 343 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:29:54.558792 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-a18a3789-142f-426d-bd8b-c8b09a0282b9 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:54.559491 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-a18a3789-142f-426d-bd8b-c8b09a0282b9 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:54.566295 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a18a3789-142f-426d-bd8b-c8b09a0282b9 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:54.566771 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a18a3789-142f-426d-bd8b-c8b09a0282b9 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:54.567200 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a18a3789-142f-426d-bd8b-c8b09a0282b9 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:54.568020 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a18a3789-142f-426d-bd8b-c8b09a0282b9 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:54.568482 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a18a3789-142f-426d-bd8b-c8b09a0282b9 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:54.568898 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a18a3789-142f-426d-bd8b-c8b09a0282b9 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:54.710174 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-a18a3789-142f-426d-bd8b-c8b09a0282b9 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:54.717783 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-a18a3789-142f-426d-bd8b-c8b09a0282b9 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1548 microversion: 2.1 time: 0.164140 Aug 12 01:29:54.718345 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 121/248] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:54 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1548 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:55.169535 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-e9c848e2-1d5a-4856-b53c-77bfdce5116f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:55.170194 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-e9c848e2-1d5a-4856-b53c-77bfdce5116f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 1e1a8df3-8078-437c-ab98-64d52e277263] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:55.181773 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e9c848e2-1d5a-4856-b53c-77bfdce5116f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:55.182497 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e9c848e2-1d5a-4856-b53c-77bfdce5116f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:55.183107 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e9c848e2-1d5a-4856-b53c-77bfdce5116f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:55.184449 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e9c848e2-1d5a-4856-b53c-77bfdce5116f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:55.184965 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e9c848e2-1d5a-4856-b53c-77bfdce5116f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:55.185378 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e9c848e2-1d5a-4856-b53c-77bfdce5116f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:55.355388 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-e9c848e2-1d5a-4856-b53c-77bfdce5116f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:55.364055 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-e9c848e2-1d5a-4856-b53c-77bfdce5116f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263" status: 200 len: 1521 microversion: 2.1 time: 0.198257 Aug 12 01:29:55.364666 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 128/249] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:55 2022] GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:55.533662 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-fe9fc6bb-df4e-42a1-946c-5cfdc0a61158 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:29:55.534433 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-fe9fc6bb-df4e-42a1-946c-5cfdc0a61158 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:55.541222 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-fe9fc6bb-df4e-42a1-946c-5cfdc0a61158 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:55.541871 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-fe9fc6bb-df4e-42a1-946c-5cfdc0a61158 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:55.542302 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-fe9fc6bb-df4e-42a1-946c-5cfdc0a61158 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:55.543036 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-fe9fc6bb-df4e-42a1-946c-5cfdc0a61158 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:55.543476 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-fe9fc6bb-df4e-42a1-946c-5cfdc0a61158 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:55.543943 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-fe9fc6bb-df4e-42a1-946c-5cfdc0a61158 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:55.569530 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.objects.instance [None req-fe9fc6bb-df4e-42a1-946c-5cfdc0a61158 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lazy-loading 'flavor' on Instance uuid 0ed5ced2-87ad-4d0f-860c-648bcca91ca8 {{(pid=120785) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 01:29:55.778819 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-fe9fc6bb-df4e-42a1-946c-5cfdc0a61158 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "POST /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8/action" status: 202 len: 0 microversion: 2.20 time: 0.249115 Aug 12 01:29:55.779898 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 122/250] 10.222.0.20 () {62 vars in 1319 bytes} [Fri Aug 12 01:29:55 2022] POST /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 12 01:29:55.789407 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-419cd474-9f7d-40a9-b5c1-55ca1745bccd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:55.790010 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-419cd474-9f7d-40a9-b5c1-55ca1745bccd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:55.797071 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-419cd474-9f7d-40a9-b5c1-55ca1745bccd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:55.797475 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-419cd474-9f7d-40a9-b5c1-55ca1745bccd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:55.797897 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-419cd474-9f7d-40a9-b5c1-55ca1745bccd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:55.798583 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-419cd474-9f7d-40a9-b5c1-55ca1745bccd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:55.799023 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-419cd474-9f7d-40a9-b5c1-55ca1745bccd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:55.799582 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-419cd474-9f7d-40a9-b5c1-55ca1745bccd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:55.929511 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-419cd474-9f7d-40a9-b5c1-55ca1745bccd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:55.937807 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-419cd474-9f7d-40a9-b5c1-55ca1745bccd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:55.939304 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-419cd474-9f7d-40a9-b5c1-55ca1745bccd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:55.940585 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-419cd474-9f7d-40a9-b5c1-55ca1745bccd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1725 microversion: 2.20 time: 0.155155 Aug 12 01:29:55.941145 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 129/251] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:29:55 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:29:56.329605 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-db9c1687-c38b-4ded-ab4f-3f73f1d0ca73 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa1b74e5-b091-49cd-908f-97799cef23b0"}} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:29:56.330143 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-a9ece12c-4c1a-4b68-8054-9d081fe95a11 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61418625-5d38-4684-8763-dc45306cb067"}} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:29:56.332133 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-db9c1687-c38b-4ded-ab4f-3f73f1d0ca73 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:56.332681 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-a9ece12c-4c1a-4b68-8054-9d081fe95a11 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:56.339201 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a9ece12c-4c1a-4b68-8054-9d081fe95a11 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:56.339676 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-db9c1687-c38b-4ded-ab4f-3f73f1d0ca73 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:56.339850 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a9ece12c-4c1a-4b68-8054-9d081fe95a11 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:56.340151 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a9ece12c-4c1a-4b68-8054-9d081fe95a11 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:56.340851 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a9ece12c-4c1a-4b68-8054-9d081fe95a11 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:56.340953 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-db9c1687-c38b-4ded-ab4f-3f73f1d0ca73 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:56.341277 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-db9c1687-c38b-4ded-ab4f-3f73f1d0ca73 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:56.341387 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a9ece12c-4c1a-4b68-8054-9d081fe95a11 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:56.341704 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a9ece12c-4c1a-4b68-8054-9d081fe95a11 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:56.342197 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-db9c1687-c38b-4ded-ab4f-3f73f1d0ca73 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:56.342670 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-db9c1687-c38b-4ded-ab4f-3f73f1d0ca73 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:56.343057 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-db9c1687-c38b-4ded-ab4f-3f73f1d0ca73 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:56.616153 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-a9ece12c-4c1a-4b68-8054-9d081fe95a11 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "POST /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290061 Aug 12 01:29:56.616863 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 130/252] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Aug 12 01:29:56 2022] POST /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:29:56.622426 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-59df5a4c-c97e-4c2a-a823-cb27e0b6ac70 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:56.623337 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-59df5a4c-c97e-4c2a-a823-cb27e0b6ac70 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 1e1a8df3-8078-437c-ab98-64d52e277263] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:56.636124 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-db9c1687-c38b-4ded-ab4f-3f73f1d0ca73 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "POST /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306881 Aug 12 01:29:56.636519 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-59df5a4c-c97e-4c2a-a823-cb27e0b6ac70 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:56.637073 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-59df5a4c-c97e-4c2a-a823-cb27e0b6ac70 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:56.637565 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-59df5a4c-c97e-4c2a-a823-cb27e0b6ac70 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:56.638272 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-59df5a4c-c97e-4c2a-a823-cb27e0b6ac70 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:56.638711 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-59df5a4c-c97e-4c2a-a823-cb27e0b6ac70 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:56.639129 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-59df5a4c-c97e-4c2a-a823-cb27e0b6ac70 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:56.640517 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 123/253] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Aug 12 01:29:56 2022] POST /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a/os-volume_attachments => generated 194 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:29:56.805965 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-59df5a4c-c97e-4c2a-a823-cb27e0b6ac70 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:56.814273 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-59df5a4c-c97e-4c2a-a823-cb27e0b6ac70 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263" status: 200 len: 1521 microversion: 2.1 time: 0.196290 Aug 12 01:29:56.815373 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 131/254] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:56 2022] GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:56.967052 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-b0ac0ed2-db90-4ab7-94bc-029b3613911d tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:56.967798 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-b0ac0ed2-db90-4ab7-94bc-029b3613911d tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:56.974468 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b0ac0ed2-db90-4ab7-94bc-029b3613911d tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:56.974951 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b0ac0ed2-db90-4ab7-94bc-029b3613911d tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:56.975380 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b0ac0ed2-db90-4ab7-94bc-029b3613911d tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:56.976102 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b0ac0ed2-db90-4ab7-94bc-029b3613911d tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:56.976585 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b0ac0ed2-db90-4ab7-94bc-029b3613911d tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:56.977002 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b0ac0ed2-db90-4ab7-94bc-029b3613911d tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:57.126527 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-b0ac0ed2-db90-4ab7-94bc-029b3613911d tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:57.134806 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-b0ac0ed2-db90-4ab7-94bc-029b3613911d tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:57.136588 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-b0ac0ed2-db90-4ab7-94bc-029b3613911d tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:57.137979 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-b0ac0ed2-db90-4ab7-94bc-029b3613911d tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1725 microversion: 2.20 time: 0.175332 Aug 12 01:29:57.138757 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 124/255] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:29:56 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:29:57.837111 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-a82620f1-02ea-4130-8e23-69cd4508668a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:57.837829 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-a82620f1-02ea-4130-8e23-69cd4508668a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 1e1a8df3-8078-437c-ab98-64d52e277263] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:57.845797 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a82620f1-02ea-4130-8e23-69cd4508668a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:57.846367 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a82620f1-02ea-4130-8e23-69cd4508668a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:57.846853 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a82620f1-02ea-4130-8e23-69cd4508668a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:57.847738 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a82620f1-02ea-4130-8e23-69cd4508668a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:57.848271 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a82620f1-02ea-4130-8e23-69cd4508668a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:57.848768 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a82620f1-02ea-4130-8e23-69cd4508668a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:57.980115 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-a82620f1-02ea-4130-8e23-69cd4508668a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:57.988077 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-a82620f1-02ea-4130-8e23-69cd4508668a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263" status: 200 len: 1521 microversion: 2.1 time: 0.155643 Aug 12 01:29:57.988850 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 132/256] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:57 2022] GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:58.162152 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-b0613c9d-7680-4b3e-abf6-18d93a928046 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:58.162850 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-b0613c9d-7680-4b3e-abf6-18d93a928046 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:58.169715 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b0613c9d-7680-4b3e-abf6-18d93a928046 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:58.170196 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b0613c9d-7680-4b3e-abf6-18d93a928046 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:58.170623 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b0613c9d-7680-4b3e-abf6-18d93a928046 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:58.171312 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b0613c9d-7680-4b3e-abf6-18d93a928046 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:58.171802 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b0613c9d-7680-4b3e-abf6-18d93a928046 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:58.172210 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b0613c9d-7680-4b3e-abf6-18d93a928046 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:58.307165 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-b0613c9d-7680-4b3e-abf6-18d93a928046 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:58.315545 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-b0613c9d-7680-4b3e-abf6-18d93a928046 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:58.317061 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-b0613c9d-7680-4b3e-abf6-18d93a928046 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:58.318241 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-b0613c9d-7680-4b3e-abf6-18d93a928046 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1725 microversion: 2.20 time: 0.160544 Aug 12 01:29:58.318786 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 125/257] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:29:58 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:29:59.025010 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-fbce0f5f-613d-4b43-aa8e-33f2ef48bdc1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:59.025922 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-fbce0f5f-613d-4b43-aa8e-33f2ef48bdc1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 1e1a8df3-8078-437c-ab98-64d52e277263] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:59.035438 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fbce0f5f-613d-4b43-aa8e-33f2ef48bdc1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:59.035949 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fbce0f5f-613d-4b43-aa8e-33f2ef48bdc1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:59.036361 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fbce0f5f-613d-4b43-aa8e-33f2ef48bdc1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:59.037049 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fbce0f5f-613d-4b43-aa8e-33f2ef48bdc1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:59.037492 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fbce0f5f-613d-4b43-aa8e-33f2ef48bdc1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:59.037910 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fbce0f5f-613d-4b43-aa8e-33f2ef48bdc1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:59.175309 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-fbce0f5f-613d-4b43-aa8e-33f2ef48bdc1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:59.183827 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-fbce0f5f-613d-4b43-aa8e-33f2ef48bdc1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263" status: 200 len: 1521 microversion: 2.1 time: 0.171657 Aug 12 01:29:59.184418 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 133/258] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:29:59 2022] GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:29:59.345303 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-c6e3f2ee-9420-48d9-891d-4b5a86e8e256 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:29:59.346272 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-c6e3f2ee-9420-48d9-891d-4b5a86e8e256 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:29:59.356906 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c6e3f2ee-9420-48d9-891d-4b5a86e8e256 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:59.357682 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c6e3f2ee-9420-48d9-891d-4b5a86e8e256 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:59.358432 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c6e3f2ee-9420-48d9-891d-4b5a86e8e256 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:59.359577 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c6e3f2ee-9420-48d9-891d-4b5a86e8e256 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:29:59.360363 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c6e3f2ee-9420-48d9-891d-4b5a86e8e256 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:29:59.361061 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c6e3f2ee-9420-48d9-891d-4b5a86e8e256 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:29:59.365636 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:29:59.497177 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-c6e3f2ee-9420-48d9-891d-4b5a86e8e256 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:59.505542 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-c6e3f2ee-9420-48d9-891d-4b5a86e8e256 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:59.506968 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-c6e3f2ee-9420-48d9-891d-4b5a86e8e256 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:29:59.508149 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-c6e3f2ee-9420-48d9-891d-4b5a86e8e256 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1725 microversion: 2.20 time: 0.169677 Aug 12 01:29:59.508728 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 126/259] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:29:59 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:30:00.204857 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-025a9615-5f36-403c-8e25-0ce7bbff4cc7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:00.205577 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-025a9615-5f36-403c-8e25-0ce7bbff4cc7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 1e1a8df3-8078-437c-ab98-64d52e277263] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:00.212414 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-025a9615-5f36-403c-8e25-0ce7bbff4cc7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:00.212887 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-025a9615-5f36-403c-8e25-0ce7bbff4cc7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:00.213312 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-025a9615-5f36-403c-8e25-0ce7bbff4cc7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:00.213996 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-025a9615-5f36-403c-8e25-0ce7bbff4cc7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:00.214434 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-025a9615-5f36-403c-8e25-0ce7bbff4cc7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:00.214848 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-025a9615-5f36-403c-8e25-0ce7bbff4cc7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:00.348900 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-025a9615-5f36-403c-8e25-0ce7bbff4cc7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:00.357900 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-025a9615-5f36-403c-8e25-0ce7bbff4cc7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263" status: 200 len: 1521 microversion: 2.1 time: 0.156894 Aug 12 01:30:00.358756 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 134/260] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:00 2022] GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:00.530463 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-8eeb5a50-f496-4110-8cd9-ca79715c6d8e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:00.531122 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-8eeb5a50-f496-4110-8cd9-ca79715c6d8e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:00.538065 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8eeb5a50-f496-4110-8cd9-ca79715c6d8e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:00.538536 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8eeb5a50-f496-4110-8cd9-ca79715c6d8e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:00.538955 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8eeb5a50-f496-4110-8cd9-ca79715c6d8e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:00.539672 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8eeb5a50-f496-4110-8cd9-ca79715c6d8e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:00.540111 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8eeb5a50-f496-4110-8cd9-ca79715c6d8e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:00.540525 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8eeb5a50-f496-4110-8cd9-ca79715c6d8e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:00.672901 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-8eeb5a50-f496-4110-8cd9-ca79715c6d8e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:00.681645 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-8eeb5a50-f496-4110-8cd9-ca79715c6d8e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:00.683144 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-8eeb5a50-f496-4110-8cd9-ca79715c6d8e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:00.684344 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-8eeb5a50-f496-4110-8cd9-ca79715c6d8e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1725 microversion: 2.20 time: 0.157802 Aug 12 01:30:00.684898 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 127/261] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:00 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:30:01.380464 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-77bd512a-0a73-4bbf-b8a9-8d3f7ee8125d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:01.381074 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-77bd512a-0a73-4bbf-b8a9-8d3f7ee8125d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 1e1a8df3-8078-437c-ab98-64d52e277263] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:01.387882 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-77bd512a-0a73-4bbf-b8a9-8d3f7ee8125d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:01.388294 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-77bd512a-0a73-4bbf-b8a9-8d3f7ee8125d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:01.388729 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-77bd512a-0a73-4bbf-b8a9-8d3f7ee8125d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:01.389418 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-77bd512a-0a73-4bbf-b8a9-8d3f7ee8125d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:01.389863 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-77bd512a-0a73-4bbf-b8a9-8d3f7ee8125d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:01.390275 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-77bd512a-0a73-4bbf-b8a9-8d3f7ee8125d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:01.523092 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-77bd512a-0a73-4bbf-b8a9-8d3f7ee8125d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:01.531108 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-77bd512a-0a73-4bbf-b8a9-8d3f7ee8125d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263" status: 200 len: 1521 microversion: 2.1 time: 0.154654 Aug 12 01:30:01.531705 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 135/262] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:01 2022] GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:01.708777 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-8f611ec1-9e3c-41bc-9777-974b255c97be tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:01.709611 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-8f611ec1-9e3c-41bc-9777-974b255c97be tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:01.716809 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8f611ec1-9e3c-41bc-9777-974b255c97be tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:01.717296 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8f611ec1-9e3c-41bc-9777-974b255c97be tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:01.717775 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8f611ec1-9e3c-41bc-9777-974b255c97be tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:01.718594 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8f611ec1-9e3c-41bc-9777-974b255c97be tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:01.719120 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8f611ec1-9e3c-41bc-9777-974b255c97be tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:01.719552 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8f611ec1-9e3c-41bc-9777-974b255c97be tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:01.857360 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-8f611ec1-9e3c-41bc-9777-974b255c97be tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:01.865671 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-8f611ec1-9e3c-41bc-9777-974b255c97be tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:01.867163 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-8f611ec1-9e3c-41bc-9777-974b255c97be tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:01.868350 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-8f611ec1-9e3c-41bc-9777-974b255c97be tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1725 microversion: 2.20 time: 0.164555 Aug 12 01:30:01.868894 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 128/263] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:01 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:30:01.884679 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-b964d65b-e6e0-4829-82db-6e5f417762de tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Action: 'create', calling method: .version_select at 0x7f2decf2b280>, body: {"keypair": {"name": "tempest-keypair-1521877628", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLNc0AyY6sO0tnb2hjkVtlNXiiEU62aeXLo8m0Vxod+1F5tEy0RCVdBW6AnVhOOUtRBqU3SS2DA7hmMC+Dx/QoOJZ8v+v8916WxYgKhnVtw6CKqrl2Hb55co2wdGJSPcQ=="}} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:30:01.902246 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.quota [None req-b964d65b-e6e0-4829-82db-6e5f417762de tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Getting quotas for project e5e2fd72103c4b5e956ef5b9c291f16d. Resources: {'key_pairs'} {{(pid=120786) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 01:30:01.906345 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.quota [None req-b964d65b-e6e0-4829-82db-6e5f417762de tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Getting quotas for user 4395876e1de944ae82d23d43a30a82a8 and project e5e2fd72103c4b5e956ef5b9c291f16d. Resources: {'key_pairs'} {{(pid=120786) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 01:30:01.935401 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-b964d65b-e6e0-4829-82db-6e5f417762de tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054399 Aug 12 01:30:01.936302 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 136/264] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Aug 12 01:30:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:30:02.281361 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-8f55362a-fc62-440a-8eb0-d894225133f4 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1582104167", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-140950627", "security_groups": [{"name": "tempest-secgroup-smoke-531838359"}], "block_device_mapping_v2": [{"uuid": "6deaeffb-e772-43e5-8d3b-e60e9415e56b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4d3c14b0-d6e3-49a6-94a3-2110714459d1"}]}} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:30:02.405882 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.network.neutron [None req-8f55362a-fc62-440a-8eb0-d894225133f4 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] validate_networks() for [('4d3c14b0-d6e3-49a6-94a3-2110714459d1', None, None, None, None, None)] {{(pid=120785) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 01:30:02.556314 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-c85977a8-18a8-424c-9749-e8cd56c1fcff tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:02.557790 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-c85977a8-18a8-424c-9749-e8cd56c1fcff tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 1e1a8df3-8078-437c-ab98-64d52e277263] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:02.566737 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c85977a8-18a8-424c-9749-e8cd56c1fcff tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:02.567365 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c85977a8-18a8-424c-9749-e8cd56c1fcff tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:02.567963 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c85977a8-18a8-424c-9749-e8cd56c1fcff tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:02.568723 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c85977a8-18a8-424c-9749-e8cd56c1fcff tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:02.569283 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c85977a8-18a8-424c-9749-e8cd56c1fcff tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:02.569804 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c85977a8-18a8-424c-9749-e8cd56c1fcff tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:02.840521 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-c85977a8-18a8-424c-9749-e8cd56c1fcff tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:02.848841 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-c85977a8-18a8-424c-9749-e8cd56c1fcff tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263" status: 200 len: 1521 microversion: 2.1 time: 0.300016 Aug 12 01:30:02.849646 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 137/265] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:02 2022] GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263 => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:02.898478 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-8f55362a-fc62-440a-8eb0-d894225133f4 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Flavor limits 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 01:30:02.898989 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-8f55362a-fc62-440a-8eb0-d894225133f4 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Image limits 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 01:30:02.899367 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-8f55362a-fc62-440a-8eb0-d894225133f4 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Flavor pref 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 01:30:02.899823 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-8f55362a-fc62-440a-8eb0-d894225133f4 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Image pref 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 01:30:02.900223 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-8f55362a-fc62-440a-8eb0-d894225133f4 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 01:30:02.903497 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-42bf7014-aa41-41c0-9325-19ea31ade188 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:02.904566 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-42bf7014-aa41-41c0-9325-19ea31ade188 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:02.909145 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8f55362a-fc62-440a-8eb0-d894225133f4 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:02.909615 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8f55362a-fc62-440a-8eb0-d894225133f4 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:02.910039 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8f55362a-fc62-440a-8eb0-d894225133f4 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:02.910744 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8f55362a-fc62-440a-8eb0-d894225133f4 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:02.911406 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8f55362a-fc62-440a-8eb0-d894225133f4 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:02.911835 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8f55362a-fc62-440a-8eb0-d894225133f4 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:02.912550 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-42bf7014-aa41-41c0-9325-19ea31ade188 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:02.913249 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-42bf7014-aa41-41c0-9325-19ea31ade188 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:02.913933 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-42bf7014-aa41-41c0-9325-19ea31ade188 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:02.915137 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-42bf7014-aa41-41c0-9325-19ea31ade188 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:02.915823 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-42bf7014-aa41-41c0-9325-19ea31ade188 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:02.916756 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-42bf7014-aa41-41c0-9325-19ea31ade188 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:02.928855 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.quota [None req-8f55362a-fc62-440a-8eb0-d894225133f4 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Getting quotas for project 2ca05e52a1c94aa7a8877ea34c412c95. Resources: {'cores', 'ram', 'instances'} {{(pid=120785) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 01:30:02.933100 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.quota [None req-8f55362a-fc62-440a-8eb0-d894225133f4 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Getting quotas for user 166e2f065c674cc0a6465f3d0d6bbb4d and project 2ca05e52a1c94aa7a8877ea34c412c95. Resources: {'cores', 'ram', 'instances'} {{(pid=120785) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 01:30:03.000577 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-8f55362a-fc62-440a-8eb0-d894225133f4 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Going to run 1 instances... {{(pid=120785) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 01:30:03.003310 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-8f55362a-fc62-440a-8eb0-d894225133f4 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: a8c75c35-1961-4c9b-9208-ed9096bf447d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6deaeffb-e772-43e5-8d3b-e60e9415e56b',volume_size=None,volume_type=None)] {{(pid=120785) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 01:30:03.062813 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-42bf7014-aa41-41c0-9325-19ea31ade188 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:03.082768 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-42bf7014-aa41-41c0-9325-19ea31ade188 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:03.085518 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-42bf7014-aa41-41c0-9325-19ea31ade188 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:03.086941 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-42bf7014-aa41-41c0-9325-19ea31ade188 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1725 microversion: 2.20 time: 0.191278 Aug 12 01:30:03.088745 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 138/266] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:02 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1725 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 01:30:03.176404 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-8f55362a-fc62-440a-8eb0-d894225133f4 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.898840 Aug 12 01:30:03.183172 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 129/267] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 01:30:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 01:30:03.188558 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-a19b09ad-e59c-4ddf-ba55-2cc639227ec0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:03.189193 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-a19b09ad-e59c-4ddf-ba55-2cc639227ec0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: a8c75c35-1961-4c9b-9208-ed9096bf447d] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:03.247034 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-a19b09ad-e59c-4ddf-ba55-2cc639227ec0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:03.261394 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-a19b09ad-e59c-4ddf-ba55-2cc639227ec0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d" status: 200 len: 1094 microversion: 2.1 time: 0.070124 Aug 12 01:30:03.261394 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 139/268] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:03 2022] GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:30:03.363717 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-24982e74-66cf-4390-9bf7-83ed161b739b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-271486687", "imageRef": "0d77ae04-91a5-4e2b-8817-72986618c549", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c69785c6-9bf5-4740-9585-57c14141c241"}], "security_groups": [{"name": "tempest-securitygroup--1357151211"}], "key_name": "tempest-keypair-1521877628", "user_data": "}} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:30:03.477197 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.network.neutron [None req-24982e74-66cf-4390-9bf7-83ed161b739b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] validate_networks() for [('c69785c6-9bf5-4740-9585-57c14141c241', None, None, None, None, None)] {{(pid=120785) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 01:30:03.870260 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-4f8785e5-4238-45aa-8ea9-5ab233dea7f0 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:03.871055 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-4f8785e5-4238-45aa-8ea9-5ab233dea7f0 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 1e1a8df3-8078-437c-ab98-64d52e277263] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:03.873825 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=1 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:03.881186 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4f8785e5-4238-45aa-8ea9-5ab233dea7f0 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:03.881754 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4f8785e5-4238-45aa-8ea9-5ab233dea7f0 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:03.882376 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4f8785e5-4238-45aa-8ea9-5ab233dea7f0 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:03.883066 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4f8785e5-4238-45aa-8ea9-5ab233dea7f0 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:03.883507 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4f8785e5-4238-45aa-8ea9-5ab233dea7f0 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:03.883947 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4f8785e5-4238-45aa-8ea9-5ab233dea7f0 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:03.903807 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:03.907357 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-24982e74-66cf-4390-9bf7-83ed161b739b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Flavor limits 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 01:30:03.907969 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-24982e74-66cf-4390-9bf7-83ed161b739b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Image limits 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 01:30:03.908466 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-24982e74-66cf-4390-9bf7-83ed161b739b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Flavor pref 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 01:30:03.908859 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-24982e74-66cf-4390-9bf7-83ed161b739b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Image pref 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 01:30:03.909258 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-24982e74-66cf-4390-9bf7-83ed161b739b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 01:30:04.038778 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-4f8785e5-4238-45aa-8ea9-5ab233dea7f0 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:04.046988 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-4f8785e5-4238-45aa-8ea9-5ab233dea7f0 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263" status: 200 len: 1521 microversion: 2.1 time: 0.180472 Aug 12 01:30:04.047512 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 140/269] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:03 2022] GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:04.062381 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-24982e74-66cf-4390-9bf7-83ed161b739b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:04.062850 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-24982e74-66cf-4390-9bf7-83ed161b739b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:04.063273 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-24982e74-66cf-4390-9bf7-83ed161b739b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:04.064009 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-24982e74-66cf-4390-9bf7-83ed161b739b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:04.064450 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-24982e74-66cf-4390-9bf7-83ed161b739b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:04.064895 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-24982e74-66cf-4390-9bf7-83ed161b739b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:04.081639 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.quota [None req-24982e74-66cf-4390-9bf7-83ed161b739b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Getting quotas for project e5e2fd72103c4b5e956ef5b9c291f16d. Resources: {'cores', 'ram', 'instances'} {{(pid=120785) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 01:30:04.085015 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.quota [None req-24982e74-66cf-4390-9bf7-83ed161b739b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Getting quotas for user 4395876e1de944ae82d23d43a30a82a8 and project e5e2fd72103c4b5e956ef5b9c291f16d. Resources: {'cores', 'ram', 'instances'} {{(pid=120785) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 01:30:04.096447 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-24982e74-66cf-4390-9bf7-83ed161b739b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Going to run 1 instances... {{(pid=120785) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 01:30:04.098580 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-24982e74-66cf-4390-9bf7-83ed161b739b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 0835a143-9929-4018-99dc-2f3e3915fb43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d77ae04-91a5-4e2b-8817-72986618c549',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120785) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 01:30:04.117191 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-37294991-a720-4e3f-baf8-1e8aea857a71 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:04.118555 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-37294991-a720-4e3f-baf8-1e8aea857a71 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:04.124607 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-37294991-a720-4e3f-baf8-1e8aea857a71 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:04.125372 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-37294991-a720-4e3f-baf8-1e8aea857a71 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:04.126171 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-37294991-a720-4e3f-baf8-1e8aea857a71 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:04.126922 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-37294991-a720-4e3f-baf8-1e8aea857a71 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:04.127637 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-37294991-a720-4e3f-baf8-1e8aea857a71 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:04.128058 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-37294991-a720-4e3f-baf8-1e8aea857a71 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:04.171172 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-24982e74-66cf-4390-9bf7-83ed161b739b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.811734 Aug 12 01:30:04.175549 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 130/270] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 01:30:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 01:30:04.186564 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-a5f3c4bb-4c7f-4314-ad59-7facfb994a15 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:04.187627 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-a5f3c4bb-4c7f-4314-ad59-7facfb994a15 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 0835a143-9929-4018-99dc-2f3e3915fb43] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:04.196053 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:04.199410 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell0:SELECT=2 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:04.280783 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-a5f3c4bb-4c7f-4314-ad59-7facfb994a15 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:04.289767 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-a5f3c4bb-4c7f-4314-ad59-7facfb994a15 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43" status: 200 len: 1241 microversion: 2.1 time: 0.107049 Aug 12 01:30:04.290744 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 131/271] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:04 2022] GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43 => generated 1241 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:30:04.303794 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-8859c21c-71ba-4642-bf37-44ee1870e002 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:04.304293 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-8859c21c-71ba-4642-bf37-44ee1870e002 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: a8c75c35-1961-4c9b-9208-ed9096bf447d] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:04.311839 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8859c21c-71ba-4642-bf37-44ee1870e002 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:04.312459 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8859c21c-71ba-4642-bf37-44ee1870e002 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:04.312888 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8859c21c-71ba-4642-bf37-44ee1870e002 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:04.313575 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8859c21c-71ba-4642-bf37-44ee1870e002 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:04.314011 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8859c21c-71ba-4642-bf37-44ee1870e002 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:04.314713 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8859c21c-71ba-4642-bf37-44ee1870e002 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:04.324822 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-37294991-a720-4e3f-baf8-1e8aea857a71 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:04.333090 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-37294991-a720-4e3f-baf8-1e8aea857a71 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:04.334588 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-37294991-a720-4e3f-baf8-1e8aea857a71 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:04.335804 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-37294991-a720-4e3f-baf8-1e8aea857a71 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1725 microversion: 2.20 time: 0.223568 Aug 12 01:30:04.336360 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 141/272] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:04 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1725 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 01:30:04.385270 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-8859c21c-71ba-4642-bf37-44ee1870e002 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:04.392839 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-8859c21c-71ba-4642-bf37-44ee1870e002 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d" status: 200 len: 1200 microversion: 2.1 time: 0.100918 Aug 12 01:30:04.393396 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 132/273] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:04 2022] GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d => generated 1200 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:05.069423 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-faae1edc-083f-45ab-82fb-924ab3632241 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:05.070013 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-faae1edc-083f-45ab-82fb-924ab3632241 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 1e1a8df3-8078-437c-ab98-64d52e277263] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:05.076610 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-faae1edc-083f-45ab-82fb-924ab3632241 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:05.077091 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-faae1edc-083f-45ab-82fb-924ab3632241 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:05.077521 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-faae1edc-083f-45ab-82fb-924ab3632241 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:05.078232 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-faae1edc-083f-45ab-82fb-924ab3632241 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:05.078672 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-faae1edc-083f-45ab-82fb-924ab3632241 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:05.079087 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-faae1edc-083f-45ab-82fb-924ab3632241 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:05.310816 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-3633e820-6852-4d6d-91df-f7a976a430ea tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:05.311427 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-3633e820-6852-4d6d-91df-f7a976a430ea tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 0835a143-9929-4018-99dc-2f3e3915fb43] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:05.329634 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3633e820-6852-4d6d-91df-f7a976a430ea tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:05.330491 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3633e820-6852-4d6d-91df-f7a976a430ea tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:05.331095 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3633e820-6852-4d6d-91df-f7a976a430ea tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:05.332105 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3633e820-6852-4d6d-91df-f7a976a430ea tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:05.332723 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3633e820-6852-4d6d-91df-f7a976a430ea tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:05.333313 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3633e820-6852-4d6d-91df-f7a976a430ea tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:05.343825 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-faae1edc-083f-45ab-82fb-924ab3632241 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:05.359231 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-faae1edc-083f-45ab-82fb-924ab3632241 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263" status: 200 len: 1521 microversion: 2.1 time: 0.291000 Aug 12 01:30:05.360116 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 142/274] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:05 2022] GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263 => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:05.376214 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-3645cafa-e5c7-4d1d-a6c1-39dcc1def73c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:05.377312 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-3645cafa-e5c7-4d1d-a6c1-39dcc1def73c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:05.386345 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3645cafa-e5c7-4d1d-a6c1-39dcc1def73c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:05.389875 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3645cafa-e5c7-4d1d-a6c1-39dcc1def73c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:05.390510 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3645cafa-e5c7-4d1d-a6c1-39dcc1def73c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:05.391508 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3645cafa-e5c7-4d1d-a6c1-39dcc1def73c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:05.393170 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3645cafa-e5c7-4d1d-a6c1-39dcc1def73c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:05.394475 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3645cafa-e5c7-4d1d-a6c1-39dcc1def73c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:05.529208 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-3633e820-6852-4d6d-91df-f7a976a430ea tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:05.537618 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-3633e820-6852-4d6d-91df-f7a976a430ea tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43" status: 200 len: 1237 microversion: 2.1 time: 0.230775 Aug 12 01:30:05.547988 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 133/275] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:05 2022] GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43 => generated 1237 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:05.554740 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-91ad548b-8b63-45a7-a9da-09bcf371a698 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:05.555683 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-91ad548b-8b63-45a7-a9da-09bcf371a698 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: a8c75c35-1961-4c9b-9208-ed9096bf447d] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:05.562000 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-91ad548b-8b63-45a7-a9da-09bcf371a698 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:05.562494 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-91ad548b-8b63-45a7-a9da-09bcf371a698 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:05.562927 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-91ad548b-8b63-45a7-a9da-09bcf371a698 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:05.563649 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-91ad548b-8b63-45a7-a9da-09bcf371a698 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:05.564092 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-91ad548b-8b63-45a7-a9da-09bcf371a698 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:05.564731 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-91ad548b-8b63-45a7-a9da-09bcf371a698 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:05.655562 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-91ad548b-8b63-45a7-a9da-09bcf371a698 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:05.663719 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-91ad548b-8b63-45a7-a9da-09bcf371a698 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d" status: 200 len: 1210 microversion: 2.1 time: 0.114102 Aug 12 01:30:05.664295 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 134/276] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:05 2022] GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d => generated 1210 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:05.695690 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-3645cafa-e5c7-4d1d-a6c1-39dcc1def73c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:05.704163 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-3645cafa-e5c7-4d1d-a6c1-39dcc1def73c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:05.705791 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-3645cafa-e5c7-4d1d-a6c1-39dcc1def73c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:05.707120 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-3645cafa-e5c7-4d1d-a6c1-39dcc1def73c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1725 microversion: 2.20 time: 0.345986 Aug 12 01:30:05.707805 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 143/277] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:05 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1725 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:30:06.382179 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-a5312344-eae1-4db6-908c-277b7acaf04b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:06.382783 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-a5312344-eae1-4db6-908c-277b7acaf04b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 1e1a8df3-8078-437c-ab98-64d52e277263] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:06.389350 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a5312344-eae1-4db6-908c-277b7acaf04b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:06.389828 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a5312344-eae1-4db6-908c-277b7acaf04b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:06.390257 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a5312344-eae1-4db6-908c-277b7acaf04b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:06.390939 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a5312344-eae1-4db6-908c-277b7acaf04b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:06.391379 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a5312344-eae1-4db6-908c-277b7acaf04b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:06.391829 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a5312344-eae1-4db6-908c-277b7acaf04b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:06.558695 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-18cf10be-0172-4e48-9ef5-6dff875294ab tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:06.560091 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-18cf10be-0172-4e48-9ef5-6dff875294ab tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 0835a143-9929-4018-99dc-2f3e3915fb43] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:06.564351 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-a5312344-eae1-4db6-908c-277b7acaf04b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:06.572018 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-a5312344-eae1-4db6-908c-277b7acaf04b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263" status: 200 len: 1521 microversion: 2.1 time: 0.193613 Aug 12 01:30:06.572593 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 135/278] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:06 2022] GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:06.574289 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-18cf10be-0172-4e48-9ef5-6dff875294ab tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:06.576156 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-18cf10be-0172-4e48-9ef5-6dff875294ab tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:06.577115 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-18cf10be-0172-4e48-9ef5-6dff875294ab tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:06.578971 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-18cf10be-0172-4e48-9ef5-6dff875294ab tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:06.580301 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-18cf10be-0172-4e48-9ef5-6dff875294ab tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:06.582097 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-18cf10be-0172-4e48-9ef5-6dff875294ab tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:06.688414 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-ed091aeb-860d-4e18-96d0-801c6d3618ba tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:06.688767 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-18cf10be-0172-4e48-9ef5-6dff875294ab tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:06.689008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-ed091aeb-860d-4e18-96d0-801c6d3618ba tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: a8c75c35-1961-4c9b-9208-ed9096bf447d] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:06.698873 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-18cf10be-0172-4e48-9ef5-6dff875294ab tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43" status: 200 len: 1299 microversion: 2.1 time: 0.144234 Aug 12 01:30:06.699724 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ed091aeb-860d-4e18-96d0-801c6d3618ba tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:06.700132 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 144/279] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:06 2022] GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43 => generated 1299 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:06.711764 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ed091aeb-860d-4e18-96d0-801c6d3618ba tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:06.711764 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ed091aeb-860d-4e18-96d0-801c6d3618ba tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:06.711764 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ed091aeb-860d-4e18-96d0-801c6d3618ba tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:06.711764 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ed091aeb-860d-4e18-96d0-801c6d3618ba tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:06.712275 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ed091aeb-860d-4e18-96d0-801c6d3618ba tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:06.739062 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-9dbe9139-449a-4c78-a528-6ee6d4a4dbdd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:06.740398 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-9dbe9139-449a-4c78-a528-6ee6d4a4dbdd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:06.749485 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9dbe9139-449a-4c78-a528-6ee6d4a4dbdd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:06.750185 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9dbe9139-449a-4c78-a528-6ee6d4a4dbdd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:06.750906 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9dbe9139-449a-4c78-a528-6ee6d4a4dbdd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:06.753130 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9dbe9139-449a-4c78-a528-6ee6d4a4dbdd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:06.753680 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9dbe9139-449a-4c78-a528-6ee6d4a4dbdd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:06.754187 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9dbe9139-449a-4c78-a528-6ee6d4a4dbdd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:06.977021 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-ed091aeb-860d-4e18-96d0-801c6d3618ba tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:06.986544 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-ed091aeb-860d-4e18-96d0-801c6d3618ba tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d" status: 200 len: 1277 microversion: 2.1 time: 0.300505 Aug 12 01:30:07.000220 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 136/280] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:06 2022] GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d => generated 1277 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:07.005352 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-2e92820c-95c9-43a1-b94c-6abd2881ffcb req-eb582f39-d590-48ce-862e-dc128b9ca9b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8c75c35-1961-4c9b-9208-ed9096bf447d", "tag": "de45b233-9e56-4b4c-b5fd-7f356b7e3307"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:30:07.016359 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-2e92820c-95c9-43a1-b94c-6abd2881ffcb req-eb582f39-d590-48ce-862e-dc128b9ca9b6 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:07.016706 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-2e92820c-95c9-43a1-b94c-6abd2881ffcb req-eb582f39-d590-48ce-862e-dc128b9ca9b6 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:07.017120 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-2e92820c-95c9-43a1-b94c-6abd2881ffcb req-eb582f39-d590-48ce-862e-dc128b9ca9b6 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:07.025172 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-9dbe9139-449a-4c78-a528-6ee6d4a4dbdd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:07.033198 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-2e92820c-95c9-43a1-b94c-6abd2881ffcb req-eb582f39-d590-48ce-862e-dc128b9ca9b6 service nova] Creating event network-changed:de45b233-9e56-4b4c-b5fd-7f356b7e3307 for instance a8c75c35-1961-4c9b-9208-ed9096bf447d on hv-cinder-78481 Aug 12 01:30:07.037215 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-9dbe9139-449a-4c78-a528-6ee6d4a4dbdd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:07.038958 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-9dbe9139-449a-4c78-a528-6ee6d4a4dbdd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:07.039465 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-2e92820c-95c9-43a1-b94c-6abd2881ffcb req-eb582f39-d590-48ce-862e-dc128b9ca9b6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037575 Aug 12 01:30:07.040517 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-9dbe9139-449a-4c78-a528-6ee6d4a4dbdd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1725 microversion: 2.20 time: 0.312869 Aug 12 01:30:07.040969 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 137/281] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:30:07.041516 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 145/282] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:06 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1725 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:30:07.594982 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-191152ce-5ac0-4f7d-932e-63958c0c0b9b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:07.595723 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-191152ce-5ac0-4f7d-932e-63958c0c0b9b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 1e1a8df3-8078-437c-ab98-64d52e277263] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:07.602303 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-191152ce-5ac0-4f7d-932e-63958c0c0b9b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:07.602811 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-191152ce-5ac0-4f7d-932e-63958c0c0b9b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:07.603382 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-191152ce-5ac0-4f7d-932e-63958c0c0b9b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:07.604112 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-191152ce-5ac0-4f7d-932e-63958c0c0b9b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:07.604592 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-191152ce-5ac0-4f7d-932e-63958c0c0b9b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:07.605031 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-191152ce-5ac0-4f7d-932e-63958c0c0b9b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:07.723195 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-d502fe43-fc8a-4d85-994e-892d69dc6b1c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:07.724580 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-d502fe43-fc8a-4d85-994e-892d69dc6b1c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 0835a143-9929-4018-99dc-2f3e3915fb43] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:07.734995 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d502fe43-fc8a-4d85-994e-892d69dc6b1c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:07.734995 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d502fe43-fc8a-4d85-994e-892d69dc6b1c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:07.734995 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d502fe43-fc8a-4d85-994e-892d69dc6b1c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:07.734995 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d502fe43-fc8a-4d85-994e-892d69dc6b1c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:07.735410 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d502fe43-fc8a-4d85-994e-892d69dc6b1c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:07.735410 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d502fe43-fc8a-4d85-994e-892d69dc6b1c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:07.756643 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-191152ce-5ac0-4f7d-932e-63958c0c0b9b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:07.765077 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-191152ce-5ac0-4f7d-932e-63958c0c0b9b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263" status: 200 len: 1501 microversion: 2.1 time: 0.174768 Aug 12 01:30:07.765966 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 138/283] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:07 2022] GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263 => generated 1501 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:07.786884 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-d2e7dd04-6b6c-493e-a808-41211277a7b2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df38c2ad-ce45-4411-becf-2772f710c76d"}} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:30:07.789278 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-d2e7dd04-6b6c-493e-a808-41211277a7b2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 1e1a8df3-8078-437c-ab98-64d52e277263] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:07.796495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d2e7dd04-6b6c-493e-a808-41211277a7b2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:07.797013 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d2e7dd04-6b6c-493e-a808-41211277a7b2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:07.797472 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d2e7dd04-6b6c-493e-a808-41211277a7b2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:07.798290 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d2e7dd04-6b6c-493e-a808-41211277a7b2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:07.799030 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d2e7dd04-6b6c-493e-a808-41211277a7b2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:07.799712 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d2e7dd04-6b6c-493e-a808-41211277a7b2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:07.824277 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.wsgi [None req-d2e7dd04-6b6c-493e-a808-41211277a7b2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] HTTP exception thrown: Cannot 'attach_volume' instance 1e1a8df3-8078-437c-ab98-64d52e277263 while it is in vm_state rescued Aug 12 01:30:07.826320 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-d2e7dd04-6b6c-493e-a808-41211277a7b2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Request method failure captured: Aug 12 01:30:07.826320 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: request: POST /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263/os-volume_attachments HTTP/1.1 Aug 12 01:30:07.826320 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept: application/json Aug 12 01:30:07.826320 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept-Encoding: identity Aug 12 01:30:07.826320 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Connection: close Aug 12 01:30:07.826320 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Length: 74 Aug 12 01:30:07.826320 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Type: application/json Aug 12 01:30:07.826320 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Host: 10.222.0.20 Aug 12 01:30:07.826320 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Openstack-System-Scope: None Aug 12 01:30:07.826320 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: User-Agent: python-urllib3/1.26.11 Aug 12 01:30:07.826320 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Auth-Token: gAAAAABi9ayoxsO4pebdlbGb3TfC7pdsTDHM0zBbhW1rROXCyh2X3MU63lrNyuI5JBIvpFkBHWmOhzN7hT_Ph2EuZvp68TczP4qOdjp2u2mGnkKXiIsRPx1ARWLioQm2PsX7zkhWbZDIo2KgE_MjWZnupOgbzAN6WD9weMJ2_q2Y0YfQ_YfoyX8 Aug 12 01:30:07.826320 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Id: None Aug 12 01:30:07.826320 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Name: None Aug 12 01:30:07.826320 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Identity-Status: Confirmed Aug 12 01:30:07.826320 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Is-Admin-Project: True Aug 12 01:30:07.826320 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Id: default Aug 12 01:30:07.826320 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Name: Default Aug 12 01:30:07.826320 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Id: a0674e4f240748d69cc9be8fdc79ad89 Aug 12 01:30:07.826320 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1607139389 Aug 12 01:30:07.826320 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Role: member,reader Aug 12 01:30:07.826320 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Roles: member,reader Aug 12 01:30:07.828108 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a0674e4f240748d69cc9be8fdc79ad89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0674e4f240748d69cc9be8fdc79ad89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a0674e4f240748d69cc9be8fdc79ad89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0674e4f240748d69cc9be8fdc79ad89"}]}] Aug 12 01:30:07.828108 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1607139389 Aug 12 01:30:07.828108 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Id: a0674e4f240748d69cc9be8fdc79ad89 Aug 12 01:30:07.828108 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1607139389 Aug 12 01:30:07.828108 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User: tempest-ServerRescueNegativeTestJSON-1607139389-project Aug 12 01:30:07.828108 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Id: default Aug 12 01:30:07.828108 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Name: Default Aug 12 01:30:07.828108 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Id: fed1b143e80642328bb5c7c78cacedcd Aug 12 01:30:07.828108 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1607139389-project Aug 12 01:30:07.828108 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Aug 12 01:30:07.828108 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: {"volumeAttachment": {"volumeId": "df38c2ad-ce45-4411-becf-2772f710c76d"}} Aug 12 01:30:07.828108 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: method: > Aug 12 01:30:07.828841 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: exception: Cannot 'attach_volume' instance 1e1a8df3-8078-437c-ab98-64d52e277263 while it is in vm_state rescued Aug 12 01:30:07.828841 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: action_args: {'server_id': '1e1a8df3-8078-437c-ab98-64d52e277263', 'body': {'volumeAttachment': {'volumeId': 'df38c2ad-ce45-4411-becf-2772f710c76d'}}} Aug 12 01:30:07.828841 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:30:07.828841 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:30:07.828841 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 12 01:30:07.828841 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 12 01:30:07.828841 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 12 01:30:07.828841 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 12 01:30:07.828841 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 12 01:30:07.828841 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 12 01:30:07.828841 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1e1a8df3-8078-437c-ab98-64d52e277263 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 12 01:30:07.828841 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:30:07.828841 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:30:07.828841 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:30:07.828841 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:30:07.828841 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:30:07.828841 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:30:07.828841 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:30:07.828841 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:30:07.834599 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:30:07.834599 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:30:07.834599 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 01:30:07.834599 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 01:30:07.834599 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 01:30:07.834599 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 01:30:07.834599 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 01:30:07.834599 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 01:30:07.834599 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 12 01:30:07.834599 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 12 01:30:07.834599 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 12 01:30:07.834599 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 12 01:30:07.834599 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 1e1a8df3-8078-437c-ab98-64d52e277263 while it is in vm_state rescued Aug 12 01:30:07.834599 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:30:07.834599 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:30:07.834599 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:30:07.834599 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:30:07.834599 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:30:07.834599 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:30:07.836898 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:30:07.836898 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:30:07.836898 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 1e1a8df3-8078-437c-ab98-64d52e277263 while it is in vm_state rescued Aug 12 01:30:07.836898 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:30:07.836898 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-d2e7dd04-6b6c-493e-a808-41211277a7b2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Returning 409 to user: Cannot 'attach_volume' instance 1e1a8df3-8078-437c-ab98-64d52e277263 while it is in vm_state rescued {{(pid=120785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:30:07.836898 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-d2e7dd04-6b6c-493e-a808-41211277a7b2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "POST /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046536 Aug 12 01:30:07.836898 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 139/284] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Aug 12 01:30:07 2022] POST /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 12 01:30:07.838789 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-c2d24661-fad4-42a2-940e-cd8cf8eeb2f0 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:30:07.839311 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-c2d24661-fad4-42a2-940e-cd8cf8eeb2f0 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 1e1a8df3-8078-437c-ab98-64d52e277263] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:07.846888 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c2d24661-fad4-42a2-940e-cd8cf8eeb2f0 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:07.847746 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c2d24661-fad4-42a2-940e-cd8cf8eeb2f0 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:07.847863 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c2d24661-fad4-42a2-940e-cd8cf8eeb2f0 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:07.848528 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c2d24661-fad4-42a2-940e-cd8cf8eeb2f0 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:07.848968 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c2d24661-fad4-42a2-940e-cd8cf8eeb2f0 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:07.849784 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c2d24661-fad4-42a2-940e-cd8cf8eeb2f0 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:07.922734 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-d502fe43-fc8a-4d85-994e-892d69dc6b1c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:07.932127 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-d502fe43-fc8a-4d85-994e-892d69dc6b1c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43" status: 200 len: 1367 microversion: 2.1 time: 0.212920 Aug 12 01:30:07.945171 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 146/285] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:07 2022] GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:07.957864 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-c2d24661-fad4-42a2-940e-cd8cf8eeb2f0 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "POST /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263/action" status: 202 len: 0 microversion: 2.1 time: 0.122650 Aug 12 01:30:07.958402 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 140/286] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Aug 12 01:30:07 2022] POST /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 01:30:07.966240 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-a307ef6a-1621-4356-be23-6ccc5693cc74 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:07.966867 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-a307ef6a-1621-4356-be23-6ccc5693cc74 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 1e1a8df3-8078-437c-ab98-64d52e277263] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:07.973046 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a307ef6a-1621-4356-be23-6ccc5693cc74 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:07.973530 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a307ef6a-1621-4356-be23-6ccc5693cc74 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:07.973954 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a307ef6a-1621-4356-be23-6ccc5693cc74 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:07.974656 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a307ef6a-1621-4356-be23-6ccc5693cc74 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:07.975079 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a307ef6a-1621-4356-be23-6ccc5693cc74 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:07.975488 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a307ef6a-1621-4356-be23-6ccc5693cc74 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:08.008673 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-f992e6fe-7ec9-4a05-b394-343516fbef92 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:08.009451 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-f992e6fe-7ec9-4a05-b394-343516fbef92 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: a8c75c35-1961-4c9b-9208-ed9096bf447d] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:08.016108 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f992e6fe-7ec9-4a05-b394-343516fbef92 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:08.016599 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f992e6fe-7ec9-4a05-b394-343516fbef92 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:08.017029 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f992e6fe-7ec9-4a05-b394-343516fbef92 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:08.018419 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f992e6fe-7ec9-4a05-b394-343516fbef92 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:08.018875 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f992e6fe-7ec9-4a05-b394-343516fbef92 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:08.019297 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f992e6fe-7ec9-4a05-b394-343516fbef92 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:08.574743 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-f992e6fe-7ec9-4a05-b394-343516fbef92 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:08.582776 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-f992e6fe-7ec9-4a05-b394-343516fbef92 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d" status: 200 len: 1277 microversion: 2.1 time: 0.578902 Aug 12 01:30:08.583357 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 141/287] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:08 2022] GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d => generated 1277 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:08.583933 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-a307ef6a-1621-4356-be23-6ccc5693cc74 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:08.594437 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-ed25428d-d3ec-458b-9830-6ea82489ab94 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:08.594893 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-a307ef6a-1621-4356-be23-6ccc5693cc74 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263" status: 200 len: 1509 microversion: 2.1 time: 0.632145 Aug 12 01:30:08.595789 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-ed25428d-d3ec-458b-9830-6ea82489ab94 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:08.597500 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 147/288] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:07 2022] GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263 => generated 1509 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:08.603694 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ed25428d-d3ec-458b-9830-6ea82489ab94 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:08.604411 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ed25428d-d3ec-458b-9830-6ea82489ab94 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:08.605035 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ed25428d-d3ec-458b-9830-6ea82489ab94 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:08.605933 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ed25428d-d3ec-458b-9830-6ea82489ab94 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:08.606681 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ed25428d-d3ec-458b-9830-6ea82489ab94 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:08.607304 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ed25428d-d3ec-458b-9830-6ea82489ab94 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:08.873784 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-ed25428d-d3ec-458b-9830-6ea82489ab94 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:08.891675 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-ed25428d-d3ec-458b-9830-6ea82489ab94 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:08.899730 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-ed25428d-d3ec-458b-9830-6ea82489ab94 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:08.903177 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-ed25428d-d3ec-458b-9830-6ea82489ab94 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1725 microversion: 2.20 time: 0.316769 Aug 12 01:30:08.904870 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 142/289] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:08 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1725 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:30:08.956892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-13dd0150-eebb-4187-9f39-f316c9be8a5d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:08.957468 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-13dd0150-eebb-4187-9f39-f316c9be8a5d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 0835a143-9929-4018-99dc-2f3e3915fb43] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:08.972468 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-13dd0150-eebb-4187-9f39-f316c9be8a5d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:08.973379 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-13dd0150-eebb-4187-9f39-f316c9be8a5d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:08.974563 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-13dd0150-eebb-4187-9f39-f316c9be8a5d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:08.980372 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-13dd0150-eebb-4187-9f39-f316c9be8a5d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:08.982162 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-13dd0150-eebb-4187-9f39-f316c9be8a5d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:08.983420 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-13dd0150-eebb-4187-9f39-f316c9be8a5d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:09.244161 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-13dd0150-eebb-4187-9f39-f316c9be8a5d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:09.252521 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-13dd0150-eebb-4187-9f39-f316c9be8a5d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43" status: 200 len: 1367 microversion: 2.1 time: 0.302227 Aug 12 01:30:09.253259 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 148/290] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:08 2022] GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43 => generated 1367 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:09.409708 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-6f6676be-56d4-472c-8b16-a52819016c60 req-6d4bd9bc-0e77-4da1-aadb-54863b8e95b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0835a143-9929-4018-99dc-2f3e3915fb43", "tag": "68c71044-03ca-436d-a9ff-d049d4286d64"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:30:09.422628 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-6f6676be-56d4-472c-8b16-a52819016c60 req-6d4bd9bc-0e77-4da1-aadb-54863b8e95b4 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:09.423248 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-6f6676be-56d4-472c-8b16-a52819016c60 req-6d4bd9bc-0e77-4da1-aadb-54863b8e95b4 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:09.424096 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-6f6676be-56d4-472c-8b16-a52819016c60 req-6d4bd9bc-0e77-4da1-aadb-54863b8e95b4 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:09.440411 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-6f6676be-56d4-472c-8b16-a52819016c60 req-6d4bd9bc-0e77-4da1-aadb-54863b8e95b4 service nova] Creating event network-changed:68c71044-03ca-436d-a9ff-d049d4286d64 for instance 0835a143-9929-4018-99dc-2f3e3915fb43 on hv-cinder-78481 Aug 12 01:30:09.445301 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-6f6676be-56d4-472c-8b16-a52819016c60 req-6d4bd9bc-0e77-4da1-aadb-54863b8e95b4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040572 Aug 12 01:30:09.446608 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 143/291] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:30:09.612492 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-7c0707f5-b225-42a0-9067-256a5e3727c1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:09.621120 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-7c0707f5-b225-42a0-9067-256a5e3727c1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: a8c75c35-1961-4c9b-9208-ed9096bf447d] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:09.623632 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-fa31007c-7c77-4947-a7c6-ef9e0db9a93b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:09.625130 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-fa31007c-7c77-4947-a7c6-ef9e0db9a93b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 1e1a8df3-8078-437c-ab98-64d52e277263] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:09.641734 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7c0707f5-b225-42a0-9067-256a5e3727c1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:09.643029 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7c0707f5-b225-42a0-9067-256a5e3727c1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:09.643855 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7c0707f5-b225-42a0-9067-256a5e3727c1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:09.645887 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7c0707f5-b225-42a0-9067-256a5e3727c1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:09.646580 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-fa31007c-7c77-4947-a7c6-ef9e0db9a93b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:09.646884 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7c0707f5-b225-42a0-9067-256a5e3727c1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:09.647713 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-fa31007c-7c77-4947-a7c6-ef9e0db9a93b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:09.647713 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-fa31007c-7c77-4947-a7c6-ef9e0db9a93b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:09.648948 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7c0707f5-b225-42a0-9067-256a5e3727c1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:09.649643 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-fa31007c-7c77-4947-a7c6-ef9e0db9a93b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:09.650154 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-fa31007c-7c77-4947-a7c6-ef9e0db9a93b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:09.653981 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-fa31007c-7c77-4947-a7c6-ef9e0db9a93b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:10.092117 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-fa31007c-7c77-4947-a7c6-ef9e0db9a93b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:10.108657 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-7c0707f5-b225-42a0-9067-256a5e3727c1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:10.115800 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-fa31007c-7c77-4947-a7c6-ef9e0db9a93b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263" status: 200 len: 1509 microversion: 2.1 time: 0.500972 Aug 12 01:30:10.117481 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 144/292] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:09 2022] GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263 => generated 1509 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:30:10.123788 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-20c11ad9-8056-4e41-9fbd-dfcd45788f26 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:10.124905 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-20c11ad9-8056-4e41-9fbd-dfcd45788f26 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:10.132287 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-20c11ad9-8056-4e41-9fbd-dfcd45788f26 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:10.132472 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-7c0707f5-b225-42a0-9067-256a5e3727c1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d" status: 200 len: 1277 microversion: 2.1 time: 0.524422 Aug 12 01:30:10.132888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 149/293] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:09 2022] GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d => generated 1277 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:10.145221 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-20c11ad9-8056-4e41-9fbd-dfcd45788f26 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:10.145221 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-20c11ad9-8056-4e41-9fbd-dfcd45788f26 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:10.145221 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-20c11ad9-8056-4e41-9fbd-dfcd45788f26 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:10.145221 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-20c11ad9-8056-4e41-9fbd-dfcd45788f26 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:10.145610 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-20c11ad9-8056-4e41-9fbd-dfcd45788f26 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:10.151403 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-ed59b27b-5c7c-4719-b372-df3d70570316 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:10.152213 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-ed59b27b-5c7c-4719-b372-df3d70570316 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:10.158745 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ed59b27b-5c7c-4719-b372-df3d70570316 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:10.159518 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ed59b27b-5c7c-4719-b372-df3d70570316 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:10.160121 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ed59b27b-5c7c-4719-b372-df3d70570316 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:10.160972 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ed59b27b-5c7c-4719-b372-df3d70570316 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:10.161568 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ed59b27b-5c7c-4719-b372-df3d70570316 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:10.162136 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ed59b27b-5c7c-4719-b372-df3d70570316 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:10.428457 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-ed59b27b-5c7c-4719-b372-df3d70570316 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:10.432016 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-20c11ad9-8056-4e41-9fbd-dfcd45788f26 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:10.435462 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:10.437672 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-ed59b27b-5c7c-4719-b372-df3d70570316 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:10.439458 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-ed59b27b-5c7c-4719-b372-df3d70570316 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:10.441235 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-ed59b27b-5c7c-4719-b372-df3d70570316 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1725 microversion: 2.20 time: 0.293619 Aug 12 01:30:10.441786 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-20c11ad9-8056-4e41-9fbd-dfcd45788f26 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1594 microversion: 2.1 time: 0.323095 Aug 12 01:30:10.445168 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 150/294] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:10 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1725 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:30:10.450394 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-9847617d-93d7-447f-86d8-cc3c6e54fd81 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:10.451177 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-9847617d-93d7-447f-86d8-cc3c6e54fd81 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 0835a143-9929-4018-99dc-2f3e3915fb43] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:10.455947 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 145/295] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:10 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1594 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:10.459495 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9847617d-93d7-447f-86d8-cc3c6e54fd81 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:10.460101 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9847617d-93d7-447f-86d8-cc3c6e54fd81 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:10.460597 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9847617d-93d7-447f-86d8-cc3c6e54fd81 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:10.461382 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9847617d-93d7-447f-86d8-cc3c6e54fd81 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:10.461905 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9847617d-93d7-447f-86d8-cc3c6e54fd81 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:10.462387 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9847617d-93d7-447f-86d8-cc3c6e54fd81 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:10.617266 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-9847617d-93d7-447f-86d8-cc3c6e54fd81 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:10.625617 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-9847617d-93d7-447f-86d8-cc3c6e54fd81 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43" status: 200 len: 1367 microversion: 2.1 time: 0.182034 Aug 12 01:30:10.626499 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 151/296] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:10 2022] GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:11.137918 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-61a59d60-8a1a-4199-beb6-65463dd616a1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:11.138517 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-61a59d60-8a1a-4199-beb6-65463dd616a1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 1e1a8df3-8078-437c-ab98-64d52e277263] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:11.146500 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-61a59d60-8a1a-4199-beb6-65463dd616a1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:11.147322 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-61a59d60-8a1a-4199-beb6-65463dd616a1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:11.148019 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-61a59d60-8a1a-4199-beb6-65463dd616a1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:11.149032 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-61a59d60-8a1a-4199-beb6-65463dd616a1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:11.149601 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-61a59d60-8a1a-4199-beb6-65463dd616a1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:11.152734 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-a8caba22-b491-4960-9e51-2c2b2e7f0d49 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:11.153409 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-a8caba22-b491-4960-9e51-2c2b2e7f0d49 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: a8c75c35-1961-4c9b-9208-ed9096bf447d] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:11.157533 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-61a59d60-8a1a-4199-beb6-65463dd616a1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:11.166372 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a8caba22-b491-4960-9e51-2c2b2e7f0d49 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:11.166855 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a8caba22-b491-4960-9e51-2c2b2e7f0d49 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:11.167281 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a8caba22-b491-4960-9e51-2c2b2e7f0d49 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:11.168002 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a8caba22-b491-4960-9e51-2c2b2e7f0d49 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:11.168448 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a8caba22-b491-4960-9e51-2c2b2e7f0d49 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:11.168861 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a8caba22-b491-4960-9e51-2c2b2e7f0d49 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:11.357390 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-61a59d60-8a1a-4199-beb6-65463dd616a1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:11.365663 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-61a59d60-8a1a-4199-beb6-65463dd616a1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263" status: 200 len: 1509 microversion: 2.1 time: 0.232002 Aug 12 01:30:11.366481 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 146/297] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:11 2022] GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263 => generated 1509 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:11.366974 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-a8caba22-b491-4960-9e51-2c2b2e7f0d49 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:11.374829 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-a8caba22-b491-4960-9e51-2c2b2e7f0d49 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d" status: 200 len: 1277 microversion: 2.1 time: 0.226199 Aug 12 01:30:11.379580 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 152/298] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:11 2022] GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d => generated 1277 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:30:11.464290 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-3c6341fb-eb7b-4224-aa92-644ed2158a29 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:11.464888 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-3c6341fb-eb7b-4224-aa92-644ed2158a29 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:11.470973 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3c6341fb-eb7b-4224-aa92-644ed2158a29 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:11.471521 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3c6341fb-eb7b-4224-aa92-644ed2158a29 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:11.471980 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3c6341fb-eb7b-4224-aa92-644ed2158a29 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:11.472538 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3c6341fb-eb7b-4224-aa92-644ed2158a29 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:11.473013 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3c6341fb-eb7b-4224-aa92-644ed2158a29 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:11.473423 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3c6341fb-eb7b-4224-aa92-644ed2158a29 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:11.632364 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-3c6341fb-eb7b-4224-aa92-644ed2158a29 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:11.641410 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-3c6341fb-eb7b-4224-aa92-644ed2158a29 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:11.643631 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-3c6341fb-eb7b-4224-aa92-644ed2158a29 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:11.645265 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-3c6341fb-eb7b-4224-aa92-644ed2158a29 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1725 microversion: 2.20 time: 0.184946 Aug 12 01:30:11.646589 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 147/299] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:11 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:30:11.648043 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-f689c4fa-55e0-4118-b188-4344ce37862a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:11.648848 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-f689c4fa-55e0-4118-b188-4344ce37862a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 0835a143-9929-4018-99dc-2f3e3915fb43] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:11.654941 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f689c4fa-55e0-4118-b188-4344ce37862a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:11.655847 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f689c4fa-55e0-4118-b188-4344ce37862a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:11.656370 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f689c4fa-55e0-4118-b188-4344ce37862a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:11.657211 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f689c4fa-55e0-4118-b188-4344ce37862a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:11.658011 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f689c4fa-55e0-4118-b188-4344ce37862a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:11.659411 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f689c4fa-55e0-4118-b188-4344ce37862a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:12.029021 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-f689c4fa-55e0-4118-b188-4344ce37862a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:12.036940 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-f689c4fa-55e0-4118-b188-4344ce37862a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43" status: 200 len: 1367 microversion: 2.1 time: 0.394153 Aug 12 01:30:12.038568 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 153/300] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:11 2022] GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43 => generated 1367 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:12.224551 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-e9708cbf-b8af-4bbf-bf62-23b63a5c2f18 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-463558493", "imageRef": "0d77ae04-91a5-4e2b-8817-72986618c549", "flavorRef": "452", "networks": [{"uuid": "4b8c5935-38ca-4347-9afe-7a0258f6b445"}]}} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:30:12.277756 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.network.neutron [None req-e9708cbf-b8af-4bbf-bf62-23b63a5c2f18 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] validate_networks() for [('4b8c5935-38ca-4347-9afe-7a0258f6b445', None, None, None, None, None)] {{(pid=120785) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 01:30:12.288022 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-2bed0a75-718b-4aad-ab74-c9d4e6667f43 req-1de57435-e66b-4a76-8cdb-0b2e639a2f44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32538820-dcc6-45ce-9b8b-dea8fe7e4776", "tag": "2fdb5157-5165-4135-b58d-b3f4cc47979a"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:30:12.297928 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-2bed0a75-718b-4aad-ab74-c9d4e6667f43 req-1de57435-e66b-4a76-8cdb-0b2e639a2f44 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:12.298398 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-2bed0a75-718b-4aad-ab74-c9d4e6667f43 req-1de57435-e66b-4a76-8cdb-0b2e639a2f44 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:12.298927 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-2bed0a75-718b-4aad-ab74-c9d4e6667f43 req-1de57435-e66b-4a76-8cdb-0b2e639a2f44 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:12.310276 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-2bed0a75-718b-4aad-ab74-c9d4e6667f43 req-1de57435-e66b-4a76-8cdb-0b2e639a2f44 service nova] Creating event network-changed:2fdb5157-5165-4135-b58d-b3f4cc47979a for instance 32538820-dcc6-45ce-9b8b-dea8fe7e4776 on hv-cinder-78481 Aug 12 01:30:12.315438 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-2bed0a75-718b-4aad-ab74-c9d4e6667f43 req-1de57435-e66b-4a76-8cdb-0b2e639a2f44 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030921 Aug 12 01:30:12.316089 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 154/301] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 01:30:12.388299 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-20c3c481-3fd5-46c5-b833-aba84962f92f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:12.389150 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-20c3c481-3fd5-46c5-b833-aba84962f92f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 1e1a8df3-8078-437c-ab98-64d52e277263] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:12.395935 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-20c3c481-3fd5-46c5-b833-aba84962f92f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:12.396653 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-20c3c481-3fd5-46c5-b833-aba84962f92f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:12.397401 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-20c3c481-3fd5-46c5-b833-aba84962f92f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:12.398105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-20c3c481-3fd5-46c5-b833-aba84962f92f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:12.398599 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-20c3c481-3fd5-46c5-b833-aba84962f92f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:12.399177 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-20c3c481-3fd5-46c5-b833-aba84962f92f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:12.710943 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-20c3c481-3fd5-46c5-b833-aba84962f92f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:12.722781 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-20c3c481-3fd5-46c5-b833-aba84962f92f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263" status: 200 len: 1509 microversion: 2.1 time: 0.338893 Aug 12 01:30:12.725159 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 155/302] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:12 2022] GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263 => generated 1509 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:30:12.738255 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-6e48b2f8-bf28-45bb-a993-3b7d4655dafc tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:12.742564 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-6e48b2f8-bf28-45bb-a993-3b7d4655dafc tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: a8c75c35-1961-4c9b-9208-ed9096bf447d] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:12.755452 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6e48b2f8-bf28-45bb-a993-3b7d4655dafc tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:12.756466 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6e48b2f8-bf28-45bb-a993-3b7d4655dafc tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:12.757217 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6e48b2f8-bf28-45bb-a993-3b7d4655dafc tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:12.758170 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6e48b2f8-bf28-45bb-a993-3b7d4655dafc tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:12.759682 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6e48b2f8-bf28-45bb-a993-3b7d4655dafc tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:12.760200 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6e48b2f8-bf28-45bb-a993-3b7d4655dafc tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:13.056349 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-6e48b2f8-bf28-45bb-a993-3b7d4655dafc tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:13.064344 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-6e48b2f8-bf28-45bb-a993-3b7d4655dafc tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d" status: 200 len: 1277 microversion: 2.1 time: 0.336396 Aug 12 01:30:13.065067 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 156/303] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:12 2022] GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d => generated 1277 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:13.071820 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-e9708cbf-b8af-4bbf-bf62-23b63a5c2f18 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Flavor limits 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 01:30:13.072639 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-e9708cbf-b8af-4bbf-bf62-23b63a5c2f18 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Image limits 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 01:30:13.073471 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-e9708cbf-b8af-4bbf-bf62-23b63a5c2f18 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Flavor pref 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 01:30:13.077362 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-5e945e39-3d24-4ff7-808f-3d56efeba701 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:13.078233 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-5e945e39-3d24-4ff7-808f-3d56efeba701 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:13.080374 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-e9708cbf-b8af-4bbf-bf62-23b63a5c2f18 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Image pref 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 01:30:13.081699 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-e9708cbf-b8af-4bbf-bf62-23b63a5c2f18 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 01:30:13.084910 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5e945e39-3d24-4ff7-808f-3d56efeba701 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:13.085386 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5e945e39-3d24-4ff7-808f-3d56efeba701 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:13.085797 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5e945e39-3d24-4ff7-808f-3d56efeba701 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:13.086711 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5e945e39-3d24-4ff7-808f-3d56efeba701 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:13.087157 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5e945e39-3d24-4ff7-808f-3d56efeba701 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:13.087603 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5e945e39-3d24-4ff7-808f-3d56efeba701 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:13.096651 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e9708cbf-b8af-4bbf-bf62-23b63a5c2f18 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:13.097375 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e9708cbf-b8af-4bbf-bf62-23b63a5c2f18 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:13.098279 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e9708cbf-b8af-4bbf-bf62-23b63a5c2f18 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:13.100007 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e9708cbf-b8af-4bbf-bf62-23b63a5c2f18 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:13.100704 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e9708cbf-b8af-4bbf-bf62-23b63a5c2f18 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:13.101289 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e9708cbf-b8af-4bbf-bf62-23b63a5c2f18 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:13.128262 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.quota [None req-e9708cbf-b8af-4bbf-bf62-23b63a5c2f18 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Getting quotas for project 2aa3549819204b219cbf52a1f9e004e9. Resources: {'cores', 'ram', 'instances'} {{(pid=120785) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 01:30:13.133062 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.quota [None req-e9708cbf-b8af-4bbf-bf62-23b63a5c2f18 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Getting quotas for user 1242495b42384050a1da78e89821dc77 and project 2aa3549819204b219cbf52a1f9e004e9. Resources: {'cores', 'ram', 'instances'} {{(pid=120785) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 01:30:13.145967 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-e9708cbf-b8af-4bbf-bf62-23b63a5c2f18 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Going to run 1 instances... {{(pid=120785) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 01:30:13.150073 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-e9708cbf-b8af-4bbf-bf62-23b63a5c2f18 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: c84abe93-9e47-4be1-b119-e0235ac5b527] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d77ae04-91a5-4e2b-8817-72986618c549',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120785) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 01:30:13.206183 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-e9708cbf-b8af-4bbf-bf62-23b63a5c2f18 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.985922 Aug 12 01:30:13.207281 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 148/304] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 01:30:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 01:30:13.214563 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-62461ad7-7963-4f2b-9700-e2f9d26c61f3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:13.225440 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-62461ad7-7963-4f2b-9700-e2f9d26c61f3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 0835a143-9929-4018-99dc-2f3e3915fb43] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:13.232898 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-62461ad7-7963-4f2b-9700-e2f9d26c61f3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:13.233742 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-62461ad7-7963-4f2b-9700-e2f9d26c61f3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:13.235075 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-62461ad7-7963-4f2b-9700-e2f9d26c61f3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:13.235831 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-62461ad7-7963-4f2b-9700-e2f9d26c61f3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:13.236337 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-62461ad7-7963-4f2b-9700-e2f9d26c61f3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:13.236751 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-62461ad7-7963-4f2b-9700-e2f9d26c61f3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:13.252414 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell0:SELECT=6 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:13.509532 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-5e945e39-3d24-4ff7-808f-3d56efeba701 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:13.513264 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell1:SELECT=100 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:13.524379 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-5e945e39-3d24-4ff7-808f-3d56efeba701 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:13.526774 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-5e945e39-3d24-4ff7-808f-3d56efeba701 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:13.530282 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-5e945e39-3d24-4ff7-808f-3d56efeba701 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1746 microversion: 2.20 time: 0.457837 Aug 12 01:30:13.531432 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 157/305] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:13 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1746 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:30:13.536845 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-d8b699d7-28b6-4948-bfcc-e97f6cf79a79 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:13.537458 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-d8b699d7-28b6-4948-bfcc-e97f6cf79a79 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: c84abe93-9e47-4be1-b119-e0235ac5b527] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:13.641312 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-d8b699d7-28b6-4948-bfcc-e97f6cf79a79 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:13.648991 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-d8b699d7-28b6-4948-bfcc-e97f6cf79a79 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/c84abe93-9e47-4be1-b119-e0235ac5b527" status: 200 len: 1213 microversion: 2.1 time: 0.116236 Aug 12 01:30:13.649582 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 158/306] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:13 2022] GET /compute/v2.1/servers/c84abe93-9e47-4be1-b119-e0235ac5b527 => generated 1213 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:13.746531 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-62461ad7-7963-4f2b-9700-e2f9d26c61f3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:13.752137 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-e8b8497d-b44f-4b64-8315-8be02fc6e9b7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:13.754230 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-e8b8497d-b44f-4b64-8315-8be02fc6e9b7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 1e1a8df3-8078-437c-ab98-64d52e277263] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:13.754817 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-62461ad7-7963-4f2b-9700-e2f9d26c61f3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43" status: 200 len: 1367 microversion: 2.1 time: 0.546220 Aug 12 01:30:13.766123 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e8b8497d-b44f-4b64-8315-8be02fc6e9b7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:13.766908 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e8b8497d-b44f-4b64-8315-8be02fc6e9b7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:13.767647 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e8b8497d-b44f-4b64-8315-8be02fc6e9b7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:13.769258 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 149/307] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:13 2022] GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43 => generated 1367 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:13.769603 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e8b8497d-b44f-4b64-8315-8be02fc6e9b7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:13.770342 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e8b8497d-b44f-4b64-8315-8be02fc6e9b7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:13.771041 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e8b8497d-b44f-4b64-8315-8be02fc6e9b7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:14.085855 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-bd88e546-f88a-4b3a-84c0-b219d9fc6237 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:14.086560 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-bd88e546-f88a-4b3a-84c0-b219d9fc6237 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: a8c75c35-1961-4c9b-9208-ed9096bf447d] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:14.093414 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bd88e546-f88a-4b3a-84c0-b219d9fc6237 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:14.093919 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bd88e546-f88a-4b3a-84c0-b219d9fc6237 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:14.094407 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bd88e546-f88a-4b3a-84c0-b219d9fc6237 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:14.095142 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bd88e546-f88a-4b3a-84c0-b219d9fc6237 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:14.097169 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bd88e546-f88a-4b3a-84c0-b219d9fc6237 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:14.097629 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bd88e546-f88a-4b3a-84c0-b219d9fc6237 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:14.178180 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-e8b8497d-b44f-4b64-8315-8be02fc6e9b7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:14.186742 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-e8b8497d-b44f-4b64-8315-8be02fc6e9b7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263" status: 200 len: 1515 microversion: 2.1 time: 0.443978 Aug 12 01:30:14.187972 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 159/308] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:13 2022] GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263 => generated 1515 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:30:14.360903 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-e966422c-cbb8-4069-9e08-ffedd535f55e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-124338040"}} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:30:14.361676 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-e966422c-cbb8-4069-9e08-ffedd535f55e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:14.363671 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-bd88e546-f88a-4b3a-84c0-b219d9fc6237 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:14.371240 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e966422c-cbb8-4069-9e08-ffedd535f55e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:14.371867 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e966422c-cbb8-4069-9e08-ffedd535f55e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:14.372595 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e966422c-cbb8-4069-9e08-ffedd535f55e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:14.373551 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e966422c-cbb8-4069-9e08-ffedd535f55e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:14.374040 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e966422c-cbb8-4069-9e08-ffedd535f55e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:14.374410 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-bd88e546-f88a-4b3a-84c0-b219d9fc6237 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d" status: 200 len: 1277 microversion: 2.1 time: 0.292772 Aug 12 01:30:14.374944 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e966422c-cbb8-4069-9e08-ffedd535f55e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:14.375069 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 150/309] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:14 2022] GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d => generated 1277 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:30:14.556635 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-d8404eeb-d7d6-418b-bcd9-704aff9fa73e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:14.557359 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-d8404eeb-d7d6-418b-bcd9-704aff9fa73e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:14.566253 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d8404eeb-d7d6-418b-bcd9-704aff9fa73e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:14.566836 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d8404eeb-d7d6-418b-bcd9-704aff9fa73e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:14.567161 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d8404eeb-d7d6-418b-bcd9-704aff9fa73e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:14.567873 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d8404eeb-d7d6-418b-bcd9-704aff9fa73e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:14.571818 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d8404eeb-d7d6-418b-bcd9-704aff9fa73e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:14.572465 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d8404eeb-d7d6-418b-bcd9-704aff9fa73e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:14.620489 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.network.security_group_api [None req-e966422c-cbb8-4069-9e08-ffedd535f55e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Adding security group 3b7f5efd-9c46-49ab-bbac-4252551ebe86 to port 2fdb5157-5165-4135-b58d-b3f4cc47979a Aug 12 01:30:14.896305 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-d8404eeb-d7d6-418b-bcd9-704aff9fa73e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:14.904703 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-d8404eeb-d7d6-418b-bcd9-704aff9fa73e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:14.906360 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-d8404eeb-d7d6-418b-bcd9-704aff9fa73e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:14.907740 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-d8404eeb-d7d6-418b-bcd9-704aff9fa73e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1746 microversion: 2.20 time: 0.355536 Aug 12 01:30:14.908918 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 151/310] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:14 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1746 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 01:30:14.913698 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-298425e7-f794-477d-ad0d-27988b02e879 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:14.914416 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-298425e7-f794-477d-ad0d-27988b02e879 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: c84abe93-9e47-4be1-b119-e0235ac5b527] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:14.920532 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-298425e7-f794-477d-ad0d-27988b02e879 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:14.921170 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-298425e7-f794-477d-ad0d-27988b02e879 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:14.921823 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-298425e7-f794-477d-ad0d-27988b02e879 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:14.922767 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-298425e7-f794-477d-ad0d-27988b02e879 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:14.923423 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-298425e7-f794-477d-ad0d-27988b02e879 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:14.924209 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-298425e7-f794-477d-ad0d-27988b02e879 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:15.018887 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-298425e7-f794-477d-ad0d-27988b02e879 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:15.028964 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-298425e7-f794-477d-ad0d-27988b02e879 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/c84abe93-9e47-4be1-b119-e0235ac5b527" status: 200 len: 1273 microversion: 2.1 time: 0.117574 Aug 12 01:30:15.031712 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 152/311] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:14 2022] GET /compute/v2.1/servers/c84abe93-9e47-4be1-b119-e0235ac5b527 => generated 1273 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:15.046150 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-df5465f0-e02c-489d-8d5e-5831611a13d7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:15.051119 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-df5465f0-e02c-489d-8d5e-5831611a13d7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 0835a143-9929-4018-99dc-2f3e3915fb43] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:15.063645 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-df5465f0-e02c-489d-8d5e-5831611a13d7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:15.064184 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-df5465f0-e02c-489d-8d5e-5831611a13d7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:15.068177 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-df5465f0-e02c-489d-8d5e-5831611a13d7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:15.069142 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-df5465f0-e02c-489d-8d5e-5831611a13d7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:15.069836 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-df5465f0-e02c-489d-8d5e-5831611a13d7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:15.070428 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-df5465f0-e02c-489d-8d5e-5831611a13d7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:15.611406 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-df5465f0-e02c-489d-8d5e-5831611a13d7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:15.619838 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-df5465f0-e02c-489d-8d5e-5831611a13d7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43" status: 200 len: 1367 microversion: 2.1 time: 0.584054 Aug 12 01:30:15.620478 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 153/312] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:15 2022] GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43 => generated 1367 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:15.625307 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-0bb80f56-f37f-49ca-ace1-28d3eb6f5a24 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:15.627702 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-0bb80f56-f37f-49ca-ace1-28d3eb6f5a24 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: a8c75c35-1961-4c9b-9208-ed9096bf447d] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:15.634887 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0bb80f56-f37f-49ca-ace1-28d3eb6f5a24 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:15.635467 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0bb80f56-f37f-49ca-ace1-28d3eb6f5a24 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:15.635983 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0bb80f56-f37f-49ca-ace1-28d3eb6f5a24 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:15.636738 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0bb80f56-f37f-49ca-ace1-28d3eb6f5a24 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:15.637358 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0bb80f56-f37f-49ca-ace1-28d3eb6f5a24 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:15.637745 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0bb80f56-f37f-49ca-ace1-28d3eb6f5a24 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:15.661334 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-e966422c-cbb8-4069-9e08-ffedd535f55e tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "POST /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776/action" status: 202 len: 0 microversion: 2.1 time: 1.304601 Aug 12 01:30:15.662865 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 160/313] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Aug 12 01:30:14 2022] POST /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776/action => generated 0 bytes in 1307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 01:30:15.669004 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-6e4a832d-84de-4881-b02a-ffffeb944849 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Action: 'create', calling method: .version_select at 0x7f2decffb160>, body: {"keypair": {"name": "tempest-keypair-562424958", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOY5ZPf5ie7ji505mJG8HX2znZblLdeB04Zg3K8s4IK4or7IYGMVYMsWA7Y0YCrK5BEkoo/fBIRDLiVg5MYSwdPTJqIjbnvvY+KChFXS0cKTEJQYM66reca+HaNInPXmAg=="}} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:30:15.685117 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.quota [None req-6e4a832d-84de-4881-b02a-ffffeb944849 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Getting quotas for project a0674e4f240748d69cc9be8fdc79ad89. Resources: {'key_pairs'} {{(pid=120786) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 01:30:15.690281 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.quota [None req-6e4a832d-84de-4881-b02a-ffffeb944849 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Getting quotas for user fed1b143e80642328bb5c7c78cacedcd and project a0674e4f240748d69cc9be8fdc79ad89. Resources: {'key_pairs'} {{(pid=120786) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 01:30:15.740367 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-6e4a832d-84de-4881-b02a-ffffeb944849 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.075146 Aug 12 01:30:15.741167 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 161/314] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Aug 12 01:30:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:30:15.771016 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-b2c9b9ab-22e6-4c06-ba40-d6b10e17bc31 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:15.772342 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-b2c9b9ab-22e6-4c06-ba40-d6b10e17bc31 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:15.791692 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b2c9b9ab-22e6-4c06-ba40-d6b10e17bc31 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:15.792504 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b2c9b9ab-22e6-4c06-ba40-d6b10e17bc31 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:15.802302 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b2c9b9ab-22e6-4c06-ba40-d6b10e17bc31 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:15.804590 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b2c9b9ab-22e6-4c06-ba40-d6b10e17bc31 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:15.805562 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b2c9b9ab-22e6-4c06-ba40-d6b10e17bc31 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:15.806515 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b2c9b9ab-22e6-4c06-ba40-d6b10e17bc31 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:15.910046 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-0bb80f56-f37f-49ca-ace1-28d3eb6f5a24 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:15.919747 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-0bb80f56-f37f-49ca-ace1-28d3eb6f5a24 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d" status: 200 len: 1277 microversion: 2.1 time: 0.297481 Aug 12 01:30:15.925162 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 154/315] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:15 2022] GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d => generated 1277 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:15.929372 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-80aa8252-bf51-45dd-b2f6-69821eafbb58 req-9928c90b-e07e-4707-b61a-26c5b42337ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32538820-dcc6-45ce-9b8b-dea8fe7e4776", "tag": "2fdb5157-5165-4135-b58d-b3f4cc47979a"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:30:15.950962 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-80aa8252-bf51-45dd-b2f6-69821eafbb58 req-9928c90b-e07e-4707-b61a-26c5b42337ce service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:15.951877 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-80aa8252-bf51-45dd-b2f6-69821eafbb58 req-9928c90b-e07e-4707-b61a-26c5b42337ce service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:15.952509 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-80aa8252-bf51-45dd-b2f6-69821eafbb58 req-9928c90b-e07e-4707-b61a-26c5b42337ce service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:15.975142 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-80aa8252-bf51-45dd-b2f6-69821eafbb58 req-9928c90b-e07e-4707-b61a-26c5b42337ce service nova] Creating event network-changed:2fdb5157-5165-4135-b58d-b3f4cc47979a for instance 32538820-dcc6-45ce-9b8b-dea8fe7e4776 on hv-cinder-78481 Aug 12 01:30:15.980223 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-80aa8252-bf51-45dd-b2f6-69821eafbb58 req-9928c90b-e07e-4707-b61a-26c5b42337ce service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055005 Aug 12 01:30:15.988483 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 155/316] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:30:15.997868 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-4101a3d1-e755-4405-b3a2-6af858cd33f5 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:15.999571 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-4101a3d1-e755-4405-b3a2-6af858cd33f5 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:16.010117 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4101a3d1-e755-4405-b3a2-6af858cd33f5 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:16.011270 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4101a3d1-e755-4405-b3a2-6af858cd33f5 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:16.012045 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4101a3d1-e755-4405-b3a2-6af858cd33f5 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:16.014255 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4101a3d1-e755-4405-b3a2-6af858cd33f5 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:16.015044 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4101a3d1-e755-4405-b3a2-6af858cd33f5 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:16.015693 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4101a3d1-e755-4405-b3a2-6af858cd33f5 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:16.166658 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-b2c9b9ab-22e6-4c06-ba40-d6b10e17bc31 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:16.182148 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-b2c9b9ab-22e6-4c06-ba40-d6b10e17bc31 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1759 microversion: 2.1 time: 0.418885 Aug 12 01:30:16.183107 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 162/317] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:15 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1759 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:16.208338 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-36dedbc3-890b-4f0e-be49-b52d9aff6a84 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:16.208633 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-36dedbc3-890b-4f0e-be49-b52d9aff6a84 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: c84abe93-9e47-4be1-b119-e0235ac5b527] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:16.229509 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-36dedbc3-890b-4f0e-be49-b52d9aff6a84 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:16.236024 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-36dedbc3-890b-4f0e-be49-b52d9aff6a84 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:16.236812 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-36dedbc3-890b-4f0e-be49-b52d9aff6a84 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:16.239147 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-36dedbc3-890b-4f0e-be49-b52d9aff6a84 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:16.241840 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-36dedbc3-890b-4f0e-be49-b52d9aff6a84 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:16.242448 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-36dedbc3-890b-4f0e-be49-b52d9aff6a84 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:16.351050 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-4101a3d1-e755-4405-b3a2-6af858cd33f5 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:16.369002 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-4101a3d1-e755-4405-b3a2-6af858cd33f5 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:16.370504 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-4101a3d1-e755-4405-b3a2-6af858cd33f5 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:16.371740 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-4101a3d1-e755-4405-b3a2-6af858cd33f5 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1746 microversion: 2.20 time: 0.379763 Aug 12 01:30:16.387274 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 156/318] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:15 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1746 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:30:16.400131 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-d7905a76-95f7-47d5-8390-a915d44fa5c4 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:30:16.416358 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d7905a76-95f7-47d5-8390-a915d44fa5c4 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:16.416852 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d7905a76-95f7-47d5-8390-a915d44fa5c4 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:16.417286 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d7905a76-95f7-47d5-8390-a915d44fa5c4 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:16.481934 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-36dedbc3-890b-4f0e-be49-b52d9aff6a84 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:16.524076 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-36dedbc3-890b-4f0e-be49-b52d9aff6a84 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/c84abe93-9e47-4be1-b119-e0235ac5b527" status: 200 len: 1271 microversion: 2.1 time: 0.328649 Aug 12 01:30:16.524718 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-d7905a76-95f7-47d5-8390-a915d44fa5c4 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Going to try to stop instance {{(pid=120785) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 12 01:30:16.526516 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 163/319] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:16 2022] GET /compute/v2.1/servers/c84abe93-9e47-4be1-b119-e0235ac5b527 => generated 1271 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:16.623498 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-d7905a76-95f7-47d5-8390-a915d44fa5c4 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "POST /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a/action" status: 202 len: 0 microversion: 2.1 time: 0.232520 Aug 12 01:30:16.626373 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 157/320] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Aug 12 01:30:16 2022] POST /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 01:30:16.636710 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-c923bda0-d9b7-464f-8d08-bebe66d8ec42 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:16.637572 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-c923bda0-d9b7-464f-8d08-bebe66d8ec42 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:16.645251 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-872c9cdb-d1b4-46ac-a26a-4941d507b643 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:16.646202 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-872c9cdb-d1b4-46ac-a26a-4941d507b643 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 0835a143-9929-4018-99dc-2f3e3915fb43] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:16.648898 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c923bda0-d9b7-464f-8d08-bebe66d8ec42 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:16.649396 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c923bda0-d9b7-464f-8d08-bebe66d8ec42 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:16.649829 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c923bda0-d9b7-464f-8d08-bebe66d8ec42 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:16.650541 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c923bda0-d9b7-464f-8d08-bebe66d8ec42 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:16.650991 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c923bda0-d9b7-464f-8d08-bebe66d8ec42 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:16.651419 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c923bda0-d9b7-464f-8d08-bebe66d8ec42 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:16.657507 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-872c9cdb-d1b4-46ac-a26a-4941d507b643 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:16.663262 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-872c9cdb-d1b4-46ac-a26a-4941d507b643 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:16.665283 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-872c9cdb-d1b4-46ac-a26a-4941d507b643 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:16.666038 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-872c9cdb-d1b4-46ac-a26a-4941d507b643 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:16.668352 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-872c9cdb-d1b4-46ac-a26a-4941d507b643 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:16.668819 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-872c9cdb-d1b4-46ac-a26a-4941d507b643 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:17.027619 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-c923bda0-d9b7-464f-8d08-bebe66d8ec42 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:17.049388 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-872c9cdb-d1b4-46ac-a26a-4941d507b643 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:17.056762 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-c923bda0-d9b7-464f-8d08-bebe66d8ec42 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1721 microversion: 2.1 time: 0.424312 Aug 12 01:30:17.059140 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 164/321] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:16 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1721 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:17.073965 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-1952832f-9507-4f46-b796-6645c7dc1e40 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:17.074928 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-1952832f-9507-4f46-b796-6645c7dc1e40 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: a8c75c35-1961-4c9b-9208-ed9096bf447d] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:17.076597 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-872c9cdb-d1b4-46ac-a26a-4941d507b643 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43" status: 200 len: 1367 microversion: 2.1 time: 0.438355 Aug 12 01:30:17.077101 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 158/322] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:16 2022] GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43 => generated 1367 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:17.084352 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1952832f-9507-4f46-b796-6645c7dc1e40 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:17.085339 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1952832f-9507-4f46-b796-6645c7dc1e40 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:17.085770 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1952832f-9507-4f46-b796-6645c7dc1e40 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:17.086531 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1952832f-9507-4f46-b796-6645c7dc1e40 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:17.086977 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1952832f-9507-4f46-b796-6645c7dc1e40 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:17.087383 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1952832f-9507-4f46-b796-6645c7dc1e40 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:17.394322 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-39e45ced-4677-48bc-9e07-d01b60d56d6b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:17.394929 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-39e45ced-4677-48bc-9e07-d01b60d56d6b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:17.401640 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-39e45ced-4677-48bc-9e07-d01b60d56d6b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:17.402125 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-39e45ced-4677-48bc-9e07-d01b60d56d6b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:17.402555 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-39e45ced-4677-48bc-9e07-d01b60d56d6b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:17.403251 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-39e45ced-4677-48bc-9e07-d01b60d56d6b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:17.403733 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-39e45ced-4677-48bc-9e07-d01b60d56d6b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:17.404310 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-39e45ced-4677-48bc-9e07-d01b60d56d6b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:17.418111 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-1952832f-9507-4f46-b796-6645c7dc1e40 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:17.429774 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-1952832f-9507-4f46-b796-6645c7dc1e40 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d" status: 200 len: 1265 microversion: 2.1 time: 0.365917 Aug 12 01:30:17.448205 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 165/323] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:17 2022] GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d => generated 1265 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:17.548599 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-e8de378c-6e54-4b5b-af98-34793199db3e tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:17.549467 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-e8de378c-6e54-4b5b-af98-34793199db3e tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: c84abe93-9e47-4be1-b119-e0235ac5b527] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:17.561789 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e8de378c-6e54-4b5b-af98-34793199db3e tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:17.562898 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e8de378c-6e54-4b5b-af98-34793199db3e tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:17.564523 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e8de378c-6e54-4b5b-af98-34793199db3e tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:17.567843 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e8de378c-6e54-4b5b-af98-34793199db3e tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:17.568619 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e8de378c-6e54-4b5b-af98-34793199db3e tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:17.569207 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e8de378c-6e54-4b5b-af98-34793199db3e tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:17.820288 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-39e45ced-4677-48bc-9e07-d01b60d56d6b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:17.830241 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-39e45ced-4677-48bc-9e07-d01b60d56d6b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:17.832631 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-39e45ced-4677-48bc-9e07-d01b60d56d6b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:17.834860 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-39e45ced-4677-48bc-9e07-d01b60d56d6b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1741 microversion: 2.20 time: 0.444032 Aug 12 01:30:17.849121 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 159/324] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:17 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1741 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 01:30:17.864585 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-e64eed02-090e-4355-92db-6359c7dec78a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1876930740", "imageRef": "0d77ae04-91a5-4e2b-8817-72986618c549", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0d1de51b-a5d0-4a09-af82-8f44783003c3"}], "security_groups": [{"name": "tempest-securitygroup--760066611"}], "key_name": "tempest-keypair-562424958", "user_data": "}} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:30:17.908231 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-e8de378c-6e54-4b5b-af98-34793199db3e tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:17.915967 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-e8de378c-6e54-4b5b-af98-34793199db3e tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/c84abe93-9e47-4be1-b119-e0235ac5b527" status: 200 len: 1313 microversion: 2.1 time: 0.371681 Aug 12 01:30:17.932315 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 166/325] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:17 2022] GET /compute/v2.1/servers/c84abe93-9e47-4be1-b119-e0235ac5b527 => generated 1313 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:30:18.048225 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.network.neutron [None req-e64eed02-090e-4355-92db-6359c7dec78a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] validate_networks() for [('0d1de51b-a5d0-4a09-af82-8f44783003c3', None, None, None, None, None)] {{(pid=120785) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 01:30:18.084264 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-8f5f86c6-03cb-4b24-a02f-d5c5a05aac7c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:18.085723 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-8f5f86c6-03cb-4b24-a02f-d5c5a05aac7c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:18.097334 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8f5f86c6-03cb-4b24-a02f-d5c5a05aac7c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:18.100052 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8f5f86c6-03cb-4b24-a02f-d5c5a05aac7c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:18.102982 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8f5f86c6-03cb-4b24-a02f-d5c5a05aac7c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:18.104102 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8f5f86c6-03cb-4b24-a02f-d5c5a05aac7c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:18.108041 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8f5f86c6-03cb-4b24-a02f-d5c5a05aac7c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:18.108670 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8f5f86c6-03cb-4b24-a02f-d5c5a05aac7c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:18.593460 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-8f5f86c6-03cb-4b24-a02f-d5c5a05aac7c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:18.612820 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-8f5f86c6-03cb-4b24-a02f-d5c5a05aac7c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1721 microversion: 2.1 time: 0.534266 Aug 12 01:30:18.624559 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 167/326] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:18 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1721 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:30:18.638326 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-96423fe2-9642-4c6f-82dd-2ef4ccc590ad tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:18.639240 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-96423fe2-9642-4c6f-82dd-2ef4ccc590ad tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 0835a143-9929-4018-99dc-2f3e3915fb43] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:18.660965 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-96423fe2-9642-4c6f-82dd-2ef4ccc590ad tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:18.663136 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-96423fe2-9642-4c6f-82dd-2ef4ccc590ad tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:18.664813 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-96423fe2-9642-4c6f-82dd-2ef4ccc590ad tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:18.668005 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-96423fe2-9642-4c6f-82dd-2ef4ccc590ad tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:18.668646 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-96423fe2-9642-4c6f-82dd-2ef4ccc590ad tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:18.669242 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-96423fe2-9642-4c6f-82dd-2ef4ccc590ad tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:18.987116 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-e64eed02-090e-4355-92db-6359c7dec78a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Flavor limits 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 01:30:18.987622 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-e64eed02-090e-4355-92db-6359c7dec78a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Image limits 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 01:30:18.988385 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-e64eed02-090e-4355-92db-6359c7dec78a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Flavor pref 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 01:30:18.989389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-e64eed02-090e-4355-92db-6359c7dec78a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Image pref 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 01:30:18.990221 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-e64eed02-090e-4355-92db-6359c7dec78a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 01:30:19.000198 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e64eed02-090e-4355-92db-6359c7dec78a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:19.000958 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e64eed02-090e-4355-92db-6359c7dec78a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:19.001594 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e64eed02-090e-4355-92db-6359c7dec78a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:19.002489 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e64eed02-090e-4355-92db-6359c7dec78a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:19.003101 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e64eed02-090e-4355-92db-6359c7dec78a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:19.003724 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e64eed02-090e-4355-92db-6359c7dec78a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:19.022061 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.quota [None req-e64eed02-090e-4355-92db-6359c7dec78a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Getting quotas for project a0674e4f240748d69cc9be8fdc79ad89. Resources: {'cores', 'ram', 'instances'} {{(pid=120785) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 01:30:19.026609 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.quota [None req-e64eed02-090e-4355-92db-6359c7dec78a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Getting quotas for user fed1b143e80642328bb5c7c78cacedcd and project a0674e4f240748d69cc9be8fdc79ad89. Resources: {'cores', 'ram', 'instances'} {{(pid=120785) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 01:30:19.038273 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-e64eed02-090e-4355-92db-6359c7dec78a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Going to run 1 instances... {{(pid=120785) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 01:30:19.040874 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-e64eed02-090e-4355-92db-6359c7dec78a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d77ae04-91a5-4e2b-8817-72986618c549',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120785) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 01:30:19.077984 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-96423fe2-9642-4c6f-82dd-2ef4ccc590ad tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:19.090088 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-96423fe2-9642-4c6f-82dd-2ef4ccc590ad tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43" status: 200 len: 1367 microversion: 2.1 time: 0.460347 Aug 12 01:30:19.091409 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 168/327] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:18 2022] GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43 => generated 1367 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:19.103334 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-a33a45ff-8952-431d-9e67-e9c287d74681 req-6b3af60a-589f-4a71-8ed4-d9f377675874 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ed5ced2-87ad-4d0f-860c-648bcca91ca8", "name": "network-vif-plugged", "status": "completed", "tag": "476d0433-5310-435b-93ea-c42ed83c3136"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:30:19.122162 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-a33a45ff-8952-431d-9e67-e9c287d74681 req-6b3af60a-589f-4a71-8ed4-d9f377675874 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:19.122911 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-a33a45ff-8952-431d-9e67-e9c287d74681 req-6b3af60a-589f-4a71-8ed4-d9f377675874 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:19.123506 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-a33a45ff-8952-431d-9e67-e9c287d74681 req-6b3af60a-589f-4a71-8ed4-d9f377675874 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:19.131572 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-e64eed02-090e-4355-92db-6359c7dec78a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.281158 Aug 12 01:30:19.132917 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 160/328] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 01:30:17 2022] POST /compute/v2.1/servers => generated 408 bytes in 1283 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 01:30:19.139111 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-a33a45ff-8952-431d-9e67-e9c287d74681 req-6b3af60a-589f-4a71-8ed4-d9f377675874 service nova] Creating event network-vif-plugged:476d0433-5310-435b-93ea-c42ed83c3136 for instance 0ed5ced2-87ad-4d0f-860c-648bcca91ca8 on hv-cinder-78481 Aug 12 01:30:19.140181 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-96b8318f-4060-4bf5-b081-5053da002630 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:19.140959 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-96b8318f-4060-4bf5-b081-5053da002630 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: a8c75c35-1961-4c9b-9208-ed9096bf447d] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:19.145360 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-a33a45ff-8952-431d-9e67-e9c287d74681 req-6b3af60a-589f-4a71-8ed4-d9f377675874 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052481 Aug 12 01:30:19.150738 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 169/329] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:30:19.154322 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-96b8318f-4060-4bf5-b081-5053da002630 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:19.154826 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-96b8318f-4060-4bf5-b081-5053da002630 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:19.155812 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-96b8318f-4060-4bf5-b081-5053da002630 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:19.157625 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-c757268d-9ec4-4f14-a0ae-1f351a1c3783 req-b941bdd8-68d9-47e7-ac77-95e5c8e86312 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c84abe93-9e47-4be1-b119-e0235ac5b527", "tag": "f4846636-61a2-4509-8815-c5875736aae6"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:30:19.158928 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-96b8318f-4060-4bf5-b081-5053da002630 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:19.159454 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-96b8318f-4060-4bf5-b081-5053da002630 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:19.159937 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-96b8318f-4060-4bf5-b081-5053da002630 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:19.174991 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-c757268d-9ec4-4f14-a0ae-1f351a1c3783 req-b941bdd8-68d9-47e7-ac77-95e5c8e86312 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:19.175922 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-c757268d-9ec4-4f14-a0ae-1f351a1c3783 req-b941bdd8-68d9-47e7-ac77-95e5c8e86312 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:19.176724 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-c757268d-9ec4-4f14-a0ae-1f351a1c3783 req-b941bdd8-68d9-47e7-ac77-95e5c8e86312 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:19.212637 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-c757268d-9ec4-4f14-a0ae-1f351a1c3783 req-b941bdd8-68d9-47e7-ac77-95e5c8e86312 service nova] Creating event network-changed:f4846636-61a2-4509-8815-c5875736aae6 for instance c84abe93-9e47-4be1-b119-e0235ac5b527 on hv-cinder-78481 Aug 12 01:30:19.221003 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-c757268d-9ec4-4f14-a0ae-1f351a1c3783 req-b941bdd8-68d9-47e7-ac77-95e5c8e86312 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067535 Aug 12 01:30:19.222201 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 170/330] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:30:19.229905 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-6d73a005-0201-4e9c-86e8-084ea945270e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:19.230605 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-6d73a005-0201-4e9c-86e8-084ea945270e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:19.237965 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6d73a005-0201-4e9c-86e8-084ea945270e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:19.238450 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6d73a005-0201-4e9c-86e8-084ea945270e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:19.238876 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6d73a005-0201-4e9c-86e8-084ea945270e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:19.239599 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6d73a005-0201-4e9c-86e8-084ea945270e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:19.240045 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6d73a005-0201-4e9c-86e8-084ea945270e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:19.240578 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6d73a005-0201-4e9c-86e8-084ea945270e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:19.730582 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-96b8318f-4060-4bf5-b081-5053da002630 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:19.738953 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-96b8318f-4060-4bf5-b081-5053da002630 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d" status: 200 len: 1265 microversion: 2.1 time: 0.603653 Aug 12 01:30:19.744579 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 161/331] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:19 2022] GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d => generated 1265 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:19.749731 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-4d2ca963-3ec8-46af-a2ac-5274bfe6a1df tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:19.750571 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-4d2ca963-3ec8-46af-a2ac-5274bfe6a1df tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: c84abe93-9e47-4be1-b119-e0235ac5b527] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:19.762302 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4d2ca963-3ec8-46af-a2ac-5274bfe6a1df tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:19.763435 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4d2ca963-3ec8-46af-a2ac-5274bfe6a1df tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:19.764191 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4d2ca963-3ec8-46af-a2ac-5274bfe6a1df tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:19.765325 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4d2ca963-3ec8-46af-a2ac-5274bfe6a1df tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:19.766543 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4d2ca963-3ec8-46af-a2ac-5274bfe6a1df tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:19.767276 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4d2ca963-3ec8-46af-a2ac-5274bfe6a1df tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:19.927087 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-6d73a005-0201-4e9c-86e8-084ea945270e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:19.939168 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-6d73a005-0201-4e9c-86e8-084ea945270e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:19.941216 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-6d73a005-0201-4e9c-86e8-084ea945270e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:19.942781 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-6d73a005-0201-4e9c-86e8-084ea945270e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1741 microversion: 2.20 time: 0.718622 Aug 12 01:30:19.944149 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 171/332] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:19 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1741 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:30:19.962219 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-84f64af4-0ae6-4e6b-b5a6-c54313c7c9d4 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:19.962966 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-84f64af4-0ae6-4e6b-b5a6-c54313c7c9d4 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:19.970403 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-84f64af4-0ae6-4e6b-b5a6-c54313c7c9d4 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:19.971193 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-84f64af4-0ae6-4e6b-b5a6-c54313c7c9d4 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:19.971822 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-84f64af4-0ae6-4e6b-b5a6-c54313c7c9d4 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:19.972761 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-84f64af4-0ae6-4e6b-b5a6-c54313c7c9d4 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:19.973382 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-84f64af4-0ae6-4e6b-b5a6-c54313c7c9d4 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:19.973959 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-84f64af4-0ae6-4e6b-b5a6-c54313c7c9d4 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:19.997044 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-4d2ca963-3ec8-46af-a2ac-5274bfe6a1df tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:20.005026 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-4d2ca963-3ec8-46af-a2ac-5274bfe6a1df tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/c84abe93-9e47-4be1-b119-e0235ac5b527" status: 200 len: 1313 microversion: 2.1 time: 0.259034 Aug 12 01:30:20.006451 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 162/333] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:19 2022] GET /compute/v2.1/servers/c84abe93-9e47-4be1-b119-e0235ac5b527 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:20.022692 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-acfd5e54-f16e-449d-a3ae-9663cadcc024 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:20.023813 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-acfd5e54-f16e-449d-a3ae-9663cadcc024 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:20.030781 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-acfd5e54-f16e-449d-a3ae-9663cadcc024 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:20.031713 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-acfd5e54-f16e-449d-a3ae-9663cadcc024 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:20.033085 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-acfd5e54-f16e-449d-a3ae-9663cadcc024 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:20.034134 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-acfd5e54-f16e-449d-a3ae-9663cadcc024 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:20.034692 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-acfd5e54-f16e-449d-a3ae-9663cadcc024 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:20.035353 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-acfd5e54-f16e-449d-a3ae-9663cadcc024 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:20.056054 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:20.063175 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-84f64af4-0ae6-4e6b-b5a6-c54313c7c9d4 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:20.072363 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-84f64af4-0ae6-4e6b-b5a6-c54313c7c9d4 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1241 microversion: 2.1 time: 0.119080 Aug 12 01:30:20.086566 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 172/334] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:19 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1241 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:20.115674 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-48b563a4-4a5c-4c96-b6f1-c12d3569b8cb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:20.116631 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-48b563a4-4a5c-4c96-b6f1-c12d3569b8cb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 0835a143-9929-4018-99dc-2f3e3915fb43] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:20.124663 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-48b563a4-4a5c-4c96-b6f1-c12d3569b8cb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:20.125238 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-48b563a4-4a5c-4c96-b6f1-c12d3569b8cb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:20.125755 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-48b563a4-4a5c-4c96-b6f1-c12d3569b8cb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:20.127486 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-48b563a4-4a5c-4c96-b6f1-c12d3569b8cb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:20.128154 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-48b563a4-4a5c-4c96-b6f1-c12d3569b8cb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:20.128681 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-48b563a4-4a5c-4c96-b6f1-c12d3569b8cb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:20.272834 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-acfd5e54-f16e-449d-a3ae-9663cadcc024 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:20.281528 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-acfd5e54-f16e-449d-a3ae-9663cadcc024 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1721 microversion: 2.1 time: 0.274048 Aug 12 01:30:20.282321 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 163/335] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:20 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1721 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:20.332252 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-48b563a4-4a5c-4c96-b6f1-c12d3569b8cb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:20.342992 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-48b563a4-4a5c-4c96-b6f1-c12d3569b8cb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43" status: 200 len: 1367 microversion: 2.1 time: 0.231463 Aug 12 01:30:20.356923 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 173/336] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:20 2022] GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43 => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:30:20.764985 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-429df69c-494c-40e9-8940-d51b1a4a4b2b tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:20.765840 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-429df69c-494c-40e9-8940-d51b1a4a4b2b tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: a8c75c35-1961-4c9b-9208-ed9096bf447d] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:20.775031 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-429df69c-494c-40e9-8940-d51b1a4a4b2b tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:20.775513 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-429df69c-494c-40e9-8940-d51b1a4a4b2b tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:20.775949 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-429df69c-494c-40e9-8940-d51b1a4a4b2b tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:20.776671 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-429df69c-494c-40e9-8940-d51b1a4a4b2b tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:20.777073 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-429df69c-494c-40e9-8940-d51b1a4a4b2b tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:20.777506 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-429df69c-494c-40e9-8940-d51b1a4a4b2b tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:20.922441 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-429df69c-494c-40e9-8940-d51b1a4a4b2b tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:20.930589 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-429df69c-494c-40e9-8940-d51b1a4a4b2b tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d" status: 200 len: 1265 microversion: 2.1 time: 0.169454 Aug 12 01:30:20.931475 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 164/337] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:20 2022] GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:20.968313 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-7a9139a2-659b-45f7-b40d-db329a357786 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:20.969079 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-7a9139a2-659b-45f7-b40d-db329a357786 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:20.975902 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7a9139a2-659b-45f7-b40d-db329a357786 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:20.976616 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7a9139a2-659b-45f7-b40d-db329a357786 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:20.977093 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7a9139a2-659b-45f7-b40d-db329a357786 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:20.977960 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7a9139a2-659b-45f7-b40d-db329a357786 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:20.978546 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7a9139a2-659b-45f7-b40d-db329a357786 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:20.979103 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7a9139a2-659b-45f7-b40d-db329a357786 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:21.026297 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-d0ab7461-9221-426a-9329-1e73c8def9db tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:21.027761 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-d0ab7461-9221-426a-9329-1e73c8def9db tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: c84abe93-9e47-4be1-b119-e0235ac5b527] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:21.034322 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d0ab7461-9221-426a-9329-1e73c8def9db tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:21.035011 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d0ab7461-9221-426a-9329-1e73c8def9db tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:21.035663 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d0ab7461-9221-426a-9329-1e73c8def9db tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:21.036357 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d0ab7461-9221-426a-9329-1e73c8def9db tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:21.036959 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d0ab7461-9221-426a-9329-1e73c8def9db tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:21.037519 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d0ab7461-9221-426a-9329-1e73c8def9db tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:21.171202 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-7a9139a2-659b-45f7-b40d-db329a357786 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:21.181493 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-7a9139a2-659b-45f7-b40d-db329a357786 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:21.183603 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-7a9139a2-659b-45f7-b40d-db329a357786 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:21.185281 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-7a9139a2-659b-45f7-b40d-db329a357786 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1741 microversion: 2.20 time: 0.220989 Aug 12 01:30:21.196001 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 174/338] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:20 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1741 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:30:21.209240 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-9e39dc36-bdcc-48c8-89f8-d382d2ee0589 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:21.210031 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-9e39dc36-bdcc-48c8-89f8-d382d2ee0589 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:21.216068 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9e39dc36-bdcc-48c8-89f8-d382d2ee0589 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:21.216795 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9e39dc36-bdcc-48c8-89f8-d382d2ee0589 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:21.217377 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9e39dc36-bdcc-48c8-89f8-d382d2ee0589 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:21.218424 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9e39dc36-bdcc-48c8-89f8-d382d2ee0589 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:21.219026 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9e39dc36-bdcc-48c8-89f8-d382d2ee0589 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:21.219629 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9e39dc36-bdcc-48c8-89f8-d382d2ee0589 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:21.314892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-9e39dc36-bdcc-48c8-89f8-d382d2ee0589 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:21.328822 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-9e39dc36-bdcc-48c8-89f8-d382d2ee0589 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1241 microversion: 2.1 time: 0.131304 Aug 12 01:30:21.329813 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 175/339] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:21 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1241 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:21.335025 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-6ce1d037-2253-44b0-a8b0-4a8383df1bbf req-a93fff90-0a18-4863-b80a-65f5a82aafd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0835a143-9929-4018-99dc-2f3e3915fb43", "name": "network-vif-plugged", "status": "completed", "tag": "68c71044-03ca-436d-a9ff-d049d4286d64"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:30:21.348720 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-6ce1d037-2253-44b0-a8b0-4a8383df1bbf req-a93fff90-0a18-4863-b80a-65f5a82aafd1 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:21.349205 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-6ce1d037-2253-44b0-a8b0-4a8383df1bbf req-a93fff90-0a18-4863-b80a-65f5a82aafd1 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:21.349627 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-6ce1d037-2253-44b0-a8b0-4a8383df1bbf req-a93fff90-0a18-4863-b80a-65f5a82aafd1 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:21.365035 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-6ce1d037-2253-44b0-a8b0-4a8383df1bbf req-a93fff90-0a18-4863-b80a-65f5a82aafd1 service nova] Creating event network-vif-plugged:68c71044-03ca-436d-a9ff-d049d4286d64 for instance 0835a143-9929-4018-99dc-2f3e3915fb43 on hv-cinder-78481 Aug 12 01:30:21.370573 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-6ce1d037-2253-44b0-a8b0-4a8383df1bbf req-a93fff90-0a18-4863-b80a-65f5a82aafd1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039551 Aug 12 01:30:21.371351 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 176/340] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:30:21.379600 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-0b2c9add-d4ae-42ab-a4f9-f25094bc9693 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:21.380554 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-0b2c9add-d4ae-42ab-a4f9-f25094bc9693 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:21.386673 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-d0ab7461-9221-426a-9329-1e73c8def9db tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:21.389705 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0b2c9add-d4ae-42ab-a4f9-f25094bc9693 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:21.390750 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0b2c9add-d4ae-42ab-a4f9-f25094bc9693 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:21.391201 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0b2c9add-d4ae-42ab-a4f9-f25094bc9693 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:21.391935 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0b2c9add-d4ae-42ab-a4f9-f25094bc9693 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:21.392381 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0b2c9add-d4ae-42ab-a4f9-f25094bc9693 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:21.393048 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0b2c9add-d4ae-42ab-a4f9-f25094bc9693 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:21.395198 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-d0ab7461-9221-426a-9329-1e73c8def9db tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/c84abe93-9e47-4be1-b119-e0235ac5b527" status: 200 len: 1313 microversion: 2.1 time: 0.372618 Aug 12 01:30:21.399944 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 165/341] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:21 2022] GET /compute/v2.1/servers/c84abe93-9e47-4be1-b119-e0235ac5b527 => generated 1313 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:21.407450 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-33a55e73-6dc4-46aa-9acc-f3ba7fd855d1 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:21.412200 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-33a55e73-6dc4-46aa-9acc-f3ba7fd855d1 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 0835a143-9929-4018-99dc-2f3e3915fb43] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:21.414943 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:21.422111 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-33a55e73-6dc4-46aa-9acc-f3ba7fd855d1 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:21.422599 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-33a55e73-6dc4-46aa-9acc-f3ba7fd855d1 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:21.423508 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-33a55e73-6dc4-46aa-9acc-f3ba7fd855d1 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:21.424620 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-33a55e73-6dc4-46aa-9acc-f3ba7fd855d1 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:21.425639 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-33a55e73-6dc4-46aa-9acc-f3ba7fd855d1 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:21.426089 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-33a55e73-6dc4-46aa-9acc-f3ba7fd855d1 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:21.608430 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-0b2c9add-d4ae-42ab-a4f9-f25094bc9693 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:21.619002 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-0b2c9add-d4ae-42ab-a4f9-f25094bc9693 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1721 microversion: 2.1 time: 0.243679 Aug 12 01:30:21.621035 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 177/342] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:21 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1721 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:21.641532 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-33a55e73-6dc4-46aa-9acc-f3ba7fd855d1 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:21.653208 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-33a55e73-6dc4-46aa-9acc-f3ba7fd855d1 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43" status: 200 len: 1367 microversion: 2.1 time: 0.252175 Aug 12 01:30:21.663132 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 166/343] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:21 2022] GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43 => generated 1367 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:21.953049 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-0adf508e-9e30-4b8f-a1a5-9d31ba000f35 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:21.954179 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-0adf508e-9e30-4b8f-a1a5-9d31ba000f35 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: a8c75c35-1961-4c9b-9208-ed9096bf447d] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:21.963423 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0adf508e-9e30-4b8f-a1a5-9d31ba000f35 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:21.965235 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0adf508e-9e30-4b8f-a1a5-9d31ba000f35 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:21.966012 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0adf508e-9e30-4b8f-a1a5-9d31ba000f35 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:21.967288 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0adf508e-9e30-4b8f-a1a5-9d31ba000f35 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:21.968834 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0adf508e-9e30-4b8f-a1a5-9d31ba000f35 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:21.969535 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0adf508e-9e30-4b8f-a1a5-9d31ba000f35 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:22.134223 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-0adf508e-9e30-4b8f-a1a5-9d31ba000f35 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:22.138256 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell1:SELECT=100 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:22.158041 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-0adf508e-9e30-4b8f-a1a5-9d31ba000f35 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d" status: 200 len: 1265 microversion: 2.1 time: 0.209069 Aug 12 01:30:22.160492 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 178/344] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:21 2022] GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:22.217696 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-b232ec92-c10e-438c-a930-4c19076cf0d9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:22.218883 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-b232ec92-c10e-438c-a930-4c19076cf0d9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:22.228563 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b232ec92-c10e-438c-a930-4c19076cf0d9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:22.229322 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b232ec92-c10e-438c-a930-4c19076cf0d9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:22.230185 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b232ec92-c10e-438c-a930-4c19076cf0d9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:22.231355 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b232ec92-c10e-438c-a930-4c19076cf0d9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:22.232347 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b232ec92-c10e-438c-a930-4c19076cf0d9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:22.233020 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b232ec92-c10e-438c-a930-4c19076cf0d9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:22.350853 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-cbdb2b76-c53d-46d2-945c-d2fa08b6bd92 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:22.351502 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-cbdb2b76-c53d-46d2-945c-d2fa08b6bd92 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:22.367409 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cbdb2b76-c53d-46d2-945c-d2fa08b6bd92 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:22.368120 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cbdb2b76-c53d-46d2-945c-d2fa08b6bd92 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:22.368705 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cbdb2b76-c53d-46d2-945c-d2fa08b6bd92 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:22.369646 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cbdb2b76-c53d-46d2-945c-d2fa08b6bd92 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:22.370099 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cbdb2b76-c53d-46d2-945c-d2fa08b6bd92 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:22.370615 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cbdb2b76-c53d-46d2-945c-d2fa08b6bd92 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:22.469213 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-cbdb2b76-c53d-46d2-945c-d2fa08b6bd92 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:22.480394 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-cbdb2b76-c53d-46d2-945c-d2fa08b6bd92 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1303 microversion: 2.1 time: 0.134488 Aug 12 01:30:22.482595 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 179/345] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:22 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1303 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:30:22.494697 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-452b361a-9e23-4da7-95cf-8b72b6acb701 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:22.495650 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-452b361a-9e23-4da7-95cf-8b72b6acb701 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: c84abe93-9e47-4be1-b119-e0235ac5b527] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:22.509811 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-452b361a-9e23-4da7-95cf-8b72b6acb701 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:22.510321 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-452b361a-9e23-4da7-95cf-8b72b6acb701 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:22.518227 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-452b361a-9e23-4da7-95cf-8b72b6acb701 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:22.519195 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-452b361a-9e23-4da7-95cf-8b72b6acb701 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:22.519689 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-452b361a-9e23-4da7-95cf-8b72b6acb701 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:22.520169 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-452b361a-9e23-4da7-95cf-8b72b6acb701 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:22.533113 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-b232ec92-c10e-438c-a930-4c19076cf0d9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:22.543298 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-b232ec92-c10e-438c-a930-4c19076cf0d9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:22.545142 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-b232ec92-c10e-438c-a930-4c19076cf0d9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:22.546516 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-b232ec92-c10e-438c-a930-4c19076cf0d9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1741 microversion: 2.20 time: 0.335037 Aug 12 01:30:22.547258 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 167/346] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:22 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1741 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:30:22.641663 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-37a17356-2997-4c9b-8b51-a907aebc3c51 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:22.642589 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-37a17356-2997-4c9b-8b51-a907aebc3c51 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:22.652373 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-37a17356-2997-4c9b-8b51-a907aebc3c51 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:22.653127 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-37a17356-2997-4c9b-8b51-a907aebc3c51 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:22.653717 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-37a17356-2997-4c9b-8b51-a907aebc3c51 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:22.655712 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-37a17356-2997-4c9b-8b51-a907aebc3c51 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:22.657044 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-37a17356-2997-4c9b-8b51-a907aebc3c51 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:22.658878 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-37a17356-2997-4c9b-8b51-a907aebc3c51 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:22.755264 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-452b361a-9e23-4da7-95cf-8b72b6acb701 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:22.768237 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-452b361a-9e23-4da7-95cf-8b72b6acb701 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/c84abe93-9e47-4be1-b119-e0235ac5b527" status: 200 len: 1313 microversion: 2.1 time: 0.282281 Aug 12 01:30:22.784073 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 180/347] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:22 2022] GET /compute/v2.1/servers/c84abe93-9e47-4be1-b119-e0235ac5b527 => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:22.784073 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-27618aff-6766-4b0b-8323-02cdf774b90b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:22.784073 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-27618aff-6766-4b0b-8323-02cdf774b90b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 0835a143-9929-4018-99dc-2f3e3915fb43] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:22.785181 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-27618aff-6766-4b0b-8323-02cdf774b90b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:22.785656 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-27618aff-6766-4b0b-8323-02cdf774b90b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:22.786080 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-27618aff-6766-4b0b-8323-02cdf774b90b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:22.786763 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-27618aff-6766-4b0b-8323-02cdf774b90b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:22.787210 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-27618aff-6766-4b0b-8323-02cdf774b90b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:22.787658 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-27618aff-6766-4b0b-8323-02cdf774b90b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:22.885996 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-37a17356-2997-4c9b-8b51-a907aebc3c51 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:22.901584 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-37a17356-2997-4c9b-8b51-a907aebc3c51 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1721 microversion: 2.1 time: 0.263921 Aug 12 01:30:22.902894 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 168/348] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:22 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1721 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:22.962129 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-27618aff-6766-4b0b-8323-02cdf774b90b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:22.970565 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-27618aff-6766-4b0b-8323-02cdf774b90b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43" status: 200 len: 1367 microversion: 2.1 time: 0.197482 Aug 12 01:30:22.971301 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 181/349] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:22 2022] GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43 => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:23.183912 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-1b7e7dca-075e-4747-86f6-0b61c4cadc7f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:23.184834 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-1b7e7dca-075e-4747-86f6-0b61c4cadc7f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: a8c75c35-1961-4c9b-9208-ed9096bf447d] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:23.193277 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1b7e7dca-075e-4747-86f6-0b61c4cadc7f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:23.193985 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1b7e7dca-075e-4747-86f6-0b61c4cadc7f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:23.194970 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1b7e7dca-075e-4747-86f6-0b61c4cadc7f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:23.196131 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1b7e7dca-075e-4747-86f6-0b61c4cadc7f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:23.197231 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1b7e7dca-075e-4747-86f6-0b61c4cadc7f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:23.197743 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1b7e7dca-075e-4747-86f6-0b61c4cadc7f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:23.502611 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-c6171184-5a27-4f12-852f-c5062c0e13c8 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:23.509818 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-c6171184-5a27-4f12-852f-c5062c0e13c8 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:23.516994 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c6171184-5a27-4f12-852f-c5062c0e13c8 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:23.517683 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c6171184-5a27-4f12-852f-c5062c0e13c8 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:23.518314 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c6171184-5a27-4f12-852f-c5062c0e13c8 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:23.519118 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c6171184-5a27-4f12-852f-c5062c0e13c8 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:23.519695 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c6171184-5a27-4f12-852f-c5062c0e13c8 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:23.520220 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c6171184-5a27-4f12-852f-c5062c0e13c8 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:23.567782 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-1b7e7dca-075e-4747-86f6-0b61c4cadc7f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:23.580134 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-1b7e7dca-075e-4747-86f6-0b61c4cadc7f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d" status: 200 len: 1265 microversion: 2.1 time: 0.399815 Aug 12 01:30:23.594873 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 169/350] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:23 2022] GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d => generated 1265 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:23.599801 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-ea63b409-1b91-41e8-ae67-dee4769bb4c3 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:23.600409 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-ea63b409-1b91-41e8-ae67-dee4769bb4c3 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:23.608619 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ea63b409-1b91-41e8-ae67-dee4769bb4c3 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:23.608966 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ea63b409-1b91-41e8-ae67-dee4769bb4c3 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:23.609161 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ea63b409-1b91-41e8-ae67-dee4769bb4c3 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:23.609870 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ea63b409-1b91-41e8-ae67-dee4769bb4c3 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:23.610485 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ea63b409-1b91-41e8-ae67-dee4769bb4c3 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:23.611085 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ea63b409-1b91-41e8-ae67-dee4769bb4c3 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:23.613228 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-c6171184-5a27-4f12-852f-c5062c0e13c8 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:23.624184 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-c6171184-5a27-4f12-852f-c5062c0e13c8 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1303 microversion: 2.1 time: 0.125605 Aug 12 01:30:23.638510 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 182/351] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:23 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1303 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:30:23.795482 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-afcac0be-ddf7-4aa4-8879-7e8879c5a38f tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:23.796260 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-afcac0be-ddf7-4aa4-8879-7e8879c5a38f tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: c84abe93-9e47-4be1-b119-e0235ac5b527] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:23.804752 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-afcac0be-ddf7-4aa4-8879-7e8879c5a38f tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:23.805549 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-afcac0be-ddf7-4aa4-8879-7e8879c5a38f tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:23.805974 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-afcac0be-ddf7-4aa4-8879-7e8879c5a38f tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:23.806694 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-afcac0be-ddf7-4aa4-8879-7e8879c5a38f tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:23.807152 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-afcac0be-ddf7-4aa4-8879-7e8879c5a38f tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:23.807586 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-afcac0be-ddf7-4aa4-8879-7e8879c5a38f tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:24.000314 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-ea63b409-1b91-41e8-ae67-dee4769bb4c3 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:24.030887 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-ea63b409-1b91-41e8-ae67-dee4769bb4c3 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:24.033504 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-ea63b409-1b91-41e8-ae67-dee4769bb4c3 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:24.035324 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-ea63b409-1b91-41e8-ae67-dee4769bb4c3 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1741 microversion: 2.20 time: 0.438907 Aug 12 01:30:24.036117 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 170/352] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:23 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1741 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:30:24.080141 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-bc481b07-8cbe-4f40-be42-edac903359e6 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:24.081160 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-bc481b07-8cbe-4f40-be42-edac903359e6 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:24.088060 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-afcac0be-ddf7-4aa4-8879-7e8879c5a38f tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:24.093518 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bc481b07-8cbe-4f40-be42-edac903359e6 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:24.094055 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bc481b07-8cbe-4f40-be42-edac903359e6 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:24.094487 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bc481b07-8cbe-4f40-be42-edac903359e6 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:24.095264 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bc481b07-8cbe-4f40-be42-edac903359e6 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:24.097099 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bc481b07-8cbe-4f40-be42-edac903359e6 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:24.097773 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bc481b07-8cbe-4f40-be42-edac903359e6 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:24.105984 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-afcac0be-ddf7-4aa4-8879-7e8879c5a38f tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/c84abe93-9e47-4be1-b119-e0235ac5b527" status: 200 len: 1313 microversion: 2.1 time: 0.317609 Aug 12 01:30:24.122529 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 183/353] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:23 2022] GET /compute/v2.1/servers/c84abe93-9e47-4be1-b119-e0235ac5b527 => generated 1313 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:24.132402 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-216e271d-81fb-4df4-9134-eb474c0e1d72 req-3a1a9647-e426-4874-b0f0-57dbf1ebd106 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c84abe93-9e47-4be1-b119-e0235ac5b527", "name": "network-vif-plugged", "status": "completed", "tag": "f4846636-61a2-4509-8815-c5875736aae6"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:30:24.138059 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:24.153941 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-216e271d-81fb-4df4-9134-eb474c0e1d72 req-3a1a9647-e426-4874-b0f0-57dbf1ebd106 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:24.154565 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-216e271d-81fb-4df4-9134-eb474c0e1d72 req-3a1a9647-e426-4874-b0f0-57dbf1ebd106 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:24.155093 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-216e271d-81fb-4df4-9134-eb474c0e1d72 req-3a1a9647-e426-4874-b0f0-57dbf1ebd106 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:24.167516 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-216e271d-81fb-4df4-9134-eb474c0e1d72 req-3a1a9647-e426-4874-b0f0-57dbf1ebd106 service nova] Creating event network-vif-plugged:f4846636-61a2-4509-8815-c5875736aae6 for instance c84abe93-9e47-4be1-b119-e0235ac5b527 on hv-cinder-78481 Aug 12 01:30:24.173970 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-216e271d-81fb-4df4-9134-eb474c0e1d72 req-3a1a9647-e426-4874-b0f0-57dbf1ebd106 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049815 Aug 12 01:30:24.174695 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 184/354] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:30:24.181490 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-61598e7d-83b0-4e08-8758-4e9e92e3182c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:24.182595 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-61598e7d-83b0-4e08-8758-4e9e92e3182c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 0835a143-9929-4018-99dc-2f3e3915fb43] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:24.189255 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-61598e7d-83b0-4e08-8758-4e9e92e3182c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:24.189865 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-61598e7d-83b0-4e08-8758-4e9e92e3182c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:24.190552 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-61598e7d-83b0-4e08-8758-4e9e92e3182c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:24.191483 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-61598e7d-83b0-4e08-8758-4e9e92e3182c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:24.192055 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-61598e7d-83b0-4e08-8758-4e9e92e3182c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:24.192831 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-61598e7d-83b0-4e08-8758-4e9e92e3182c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:24.476546 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-61598e7d-83b0-4e08-8758-4e9e92e3182c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:24.482307 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-bc481b07-8cbe-4f40-be42-edac903359e6 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:24.494634 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-bc481b07-8cbe-4f40-be42-edac903359e6 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1721 microversion: 2.1 time: 0.431094 Aug 12 01:30:24.507555 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-61598e7d-83b0-4e08-8758-4e9e92e3182c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43" status: 200 len: 1367 microversion: 2.1 time: 0.320733 Aug 12 01:30:24.507555 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 185/355] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:24 2022] GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43 => generated 1367 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:24.508471 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 171/356] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:24 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1721 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:24.601502 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-b9176ae5-a573-4335-b01e-cb7290bf1fa0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:24.602111 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-b9176ae5-a573-4335-b01e-cb7290bf1fa0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: a8c75c35-1961-4c9b-9208-ed9096bf447d] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:24.614735 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b9176ae5-a573-4335-b01e-cb7290bf1fa0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:24.616713 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b9176ae5-a573-4335-b01e-cb7290bf1fa0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:24.616713 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b9176ae5-a573-4335-b01e-cb7290bf1fa0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:24.616713 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b9176ae5-a573-4335-b01e-cb7290bf1fa0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:24.620201 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b9176ae5-a573-4335-b01e-cb7290bf1fa0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:24.620672 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b9176ae5-a573-4335-b01e-cb7290bf1fa0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:24.647843 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-15ca0f9c-c4c7-4a88-a663-a66754789a8a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:24.648519 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-15ca0f9c-c4c7-4a88-a663-a66754789a8a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:24.655751 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-15ca0f9c-c4c7-4a88-a663-a66754789a8a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:24.656508 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-15ca0f9c-c4c7-4a88-a663-a66754789a8a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:24.657207 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-15ca0f9c-c4c7-4a88-a663-a66754789a8a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:24.664549 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-15ca0f9c-c4c7-4a88-a663-a66754789a8a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:24.665194 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-15ca0f9c-c4c7-4a88-a663-a66754789a8a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:24.665779 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-15ca0f9c-c4c7-4a88-a663-a66754789a8a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:24.961055 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-b9176ae5-a573-4335-b01e-cb7290bf1fa0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:24.970597 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-b9176ae5-a573-4335-b01e-cb7290bf1fa0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d" status: 200 len: 1265 microversion: 2.1 time: 0.372965 Aug 12 01:30:24.972471 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 186/357] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:24 2022] GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d => generated 1265 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:24.979522 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-15ca0f9c-c4c7-4a88-a663-a66754789a8a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:24.987183 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-15ca0f9c-c4c7-4a88-a663-a66754789a8a tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1370 microversion: 2.1 time: 0.343292 Aug 12 01:30:24.995794 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 172/358] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:24 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1370 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:25.084643 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-a00bafda-919d-404b-9450-e9209523b5c5 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:25.085162 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-a00bafda-919d-404b-9450-e9209523b5c5 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:25.091920 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a00bafda-919d-404b-9450-e9209523b5c5 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:25.092398 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a00bafda-919d-404b-9450-e9209523b5c5 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:25.092834 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a00bafda-919d-404b-9450-e9209523b5c5 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:25.093553 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a00bafda-919d-404b-9450-e9209523b5c5 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:25.094058 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a00bafda-919d-404b-9450-e9209523b5c5 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:25.094414 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a00bafda-919d-404b-9450-e9209523b5c5 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:25.132983 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-696317e2-cfba-4ff7-a830-b01b013712cc tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:25.133892 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-696317e2-cfba-4ff7-a830-b01b013712cc tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: c84abe93-9e47-4be1-b119-e0235ac5b527] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:25.141451 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-696317e2-cfba-4ff7-a830-b01b013712cc tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:25.142285 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-696317e2-cfba-4ff7-a830-b01b013712cc tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:25.142931 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-696317e2-cfba-4ff7-a830-b01b013712cc tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:25.143876 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-696317e2-cfba-4ff7-a830-b01b013712cc tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:25.144530 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-696317e2-cfba-4ff7-a830-b01b013712cc tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:25.145037 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-696317e2-cfba-4ff7-a830-b01b013712cc tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:25.294816 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-a00bafda-919d-404b-9450-e9209523b5c5 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:25.310567 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-a00bafda-919d-404b-9450-e9209523b5c5 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:25.315794 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-a00bafda-919d-404b-9450-e9209523b5c5 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:25.317912 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-a00bafda-919d-404b-9450-e9209523b5c5 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1741 microversion: 2.20 time: 0.237240 Aug 12 01:30:25.318646 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 187/359] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:25 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1741 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:30:25.333604 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-696317e2-cfba-4ff7-a830-b01b013712cc tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:25.348788 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-696317e2-cfba-4ff7-a830-b01b013712cc tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/c84abe93-9e47-4be1-b119-e0235ac5b527" status: 200 len: 1313 microversion: 2.1 time: 0.219496 Aug 12 01:30:25.359506 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 173/360] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:25 2022] GET /compute/v2.1/servers/c84abe93-9e47-4be1-b119-e0235ac5b527 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:30:25.521511 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-456832fc-8582-49d8-bf02-7cf7ad5e10e8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:25.523233 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-9b442b0b-1833-4049-a09b-e5bd37d638da tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:25.524439 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-456832fc-8582-49d8-bf02-7cf7ad5e10e8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 0835a143-9929-4018-99dc-2f3e3915fb43] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:25.527641 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-9b442b0b-1833-4049-a09b-e5bd37d638da tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:25.540950 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-456832fc-8582-49d8-bf02-7cf7ad5e10e8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:25.542794 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-456832fc-8582-49d8-bf02-7cf7ad5e10e8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:25.544431 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9b442b0b-1833-4049-a09b-e5bd37d638da tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:25.544920 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9b442b0b-1833-4049-a09b-e5bd37d638da tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:25.545410 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9b442b0b-1833-4049-a09b-e5bd37d638da tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:25.546218 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9b442b0b-1833-4049-a09b-e5bd37d638da tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:25.547486 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-456832fc-8582-49d8-bf02-7cf7ad5e10e8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:25.548596 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-456832fc-8582-49d8-bf02-7cf7ad5e10e8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:25.550155 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-456832fc-8582-49d8-bf02-7cf7ad5e10e8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:25.551329 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-456832fc-8582-49d8-bf02-7cf7ad5e10e8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:25.555699 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9b442b0b-1833-4049-a09b-e5bd37d638da tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:25.556947 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9b442b0b-1833-4049-a09b-e5bd37d638da tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:25.715553 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell0:SELECT=6 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:26.009342 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-456832fc-8582-49d8-bf02-7cf7ad5e10e8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:26.024369 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-9b442b0b-1833-4049-a09b-e5bd37d638da tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:26.024631 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-456832fc-8582-49d8-bf02-7cf7ad5e10e8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43" status: 200 len: 1367 microversion: 2.1 time: 0.507434 Aug 12 01:30:26.025858 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 174/361] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:25 2022] GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43 => generated 1367 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:26.031303 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-772abbdd-b969-450a-bc2c-434671c09e29 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:26.034153 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-772abbdd-b969-450a-bc2c-434671c09e29 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: a8c75c35-1961-4c9b-9208-ed9096bf447d] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:26.040614 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-9b442b0b-1833-4049-a09b-e5bd37d638da tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1721 microversion: 2.1 time: 0.528091 Aug 12 01:30:26.041231 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 188/362] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:25 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1721 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:30:26.045837 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-02cfa07b-1042-4f86-8b18-b77e2f8853d6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:26.046445 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-02cfa07b-1042-4f86-8b18-b77e2f8853d6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:26.049899 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-772abbdd-b969-450a-bc2c-434671c09e29 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:26.050695 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-772abbdd-b969-450a-bc2c-434671c09e29 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:26.051363 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-772abbdd-b969-450a-bc2c-434671c09e29 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:26.053172 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-772abbdd-b969-450a-bc2c-434671c09e29 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:26.053841 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-772abbdd-b969-450a-bc2c-434671c09e29 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:26.054466 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-772abbdd-b969-450a-bc2c-434671c09e29 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:26.063613 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-02cfa07b-1042-4f86-8b18-b77e2f8853d6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:26.064210 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-02cfa07b-1042-4f86-8b18-b77e2f8853d6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:26.064961 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-02cfa07b-1042-4f86-8b18-b77e2f8853d6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:26.065844 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-02cfa07b-1042-4f86-8b18-b77e2f8853d6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:26.066476 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-02cfa07b-1042-4f86-8b18-b77e2f8853d6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:26.067038 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-02cfa07b-1042-4f86-8b18-b77e2f8853d6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:26.615957 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-772abbdd-b969-450a-bc2c-434671c09e29 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:26.626531 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-02cfa07b-1042-4f86-8b18-b77e2f8853d6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:26.629556 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-772abbdd-b969-450a-bc2c-434671c09e29 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d" status: 200 len: 1265 microversion: 2.1 time: 0.601851 Aug 12 01:30:26.630320 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 175/363] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:26 2022] GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d => generated 1265 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:26.643128 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-02cfa07b-1042-4f86-8b18-b77e2f8853d6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1370 microversion: 2.1 time: 0.597419 Aug 12 01:30:26.643128 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 189/364] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:26 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1370 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:26.649269 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-2ab3bac0-97cc-473f-829c-2d600af5ffaf tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:26.653525 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-2ab3bac0-97cc-473f-829c-2d600af5ffaf tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: c84abe93-9e47-4be1-b119-e0235ac5b527] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:26.664942 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-970839e1-c8eb-4b35-9dd2-4aa98160a1be tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:26.668272 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2ab3bac0-97cc-473f-829c-2d600af5ffaf tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:26.668952 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2ab3bac0-97cc-473f-829c-2d600af5ffaf tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:26.669073 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-970839e1-c8eb-4b35-9dd2-4aa98160a1be tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:26.669628 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2ab3bac0-97cc-473f-829c-2d600af5ffaf tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:26.672056 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2ab3bac0-97cc-473f-829c-2d600af5ffaf tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:26.672682 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2ab3bac0-97cc-473f-829c-2d600af5ffaf tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:26.674895 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2ab3bac0-97cc-473f-829c-2d600af5ffaf tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:26.683345 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-970839e1-c8eb-4b35-9dd2-4aa98160a1be tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:26.684020 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-970839e1-c8eb-4b35-9dd2-4aa98160a1be tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:26.685751 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-970839e1-c8eb-4b35-9dd2-4aa98160a1be tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:26.689009 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-970839e1-c8eb-4b35-9dd2-4aa98160a1be tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:26.689961 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-970839e1-c8eb-4b35-9dd2-4aa98160a1be tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:26.690503 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-970839e1-c8eb-4b35-9dd2-4aa98160a1be tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:27.000104 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-2ab3bac0-97cc-473f-829c-2d600af5ffaf tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:27.008916 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-2ab3bac0-97cc-473f-829c-2d600af5ffaf tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/c84abe93-9e47-4be1-b119-e0235ac5b527" status: 200 len: 1313 microversion: 2.1 time: 0.363290 Aug 12 01:30:27.009882 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 176/365] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:26 2022] GET /compute/v2.1/servers/c84abe93-9e47-4be1-b119-e0235ac5b527 => generated 1313 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:27.033892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-970839e1-c8eb-4b35-9dd2-4aa98160a1be tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:27.048135 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-970839e1-c8eb-4b35-9dd2-4aa98160a1be tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:27.049882 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-970839e1-c8eb-4b35-9dd2-4aa98160a1be tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:27.061173 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-970839e1-c8eb-4b35-9dd2-4aa98160a1be tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1741 microversion: 2.20 time: 0.398099 Aug 12 01:30:27.061173 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 190/366] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:26 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1741 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:30:27.080396 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-a2e57619-d13a-4504-b8ef-37c30519fdd2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:27.080620 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-8055c824-1d8f-45da-8abd-8905364dc026 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:27.081036 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-8055c824-1d8f-45da-8abd-8905364dc026 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:27.081326 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-a2e57619-d13a-4504-b8ef-37c30519fdd2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 0835a143-9929-4018-99dc-2f3e3915fb43] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:27.087748 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a2e57619-d13a-4504-b8ef-37c30519fdd2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:27.088740 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a2e57619-d13a-4504-b8ef-37c30519fdd2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:27.089488 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a2e57619-d13a-4504-b8ef-37c30519fdd2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:27.090661 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a2e57619-d13a-4504-b8ef-37c30519fdd2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:27.091352 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a2e57619-d13a-4504-b8ef-37c30519fdd2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:27.092004 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a2e57619-d13a-4504-b8ef-37c30519fdd2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:27.107068 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8055c824-1d8f-45da-8abd-8905364dc026 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:27.107611 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8055c824-1d8f-45da-8abd-8905364dc026 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:27.108057 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8055c824-1d8f-45da-8abd-8905364dc026 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:27.109438 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8055c824-1d8f-45da-8abd-8905364dc026 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:27.109906 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8055c824-1d8f-45da-8abd-8905364dc026 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:27.110328 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8055c824-1d8f-45da-8abd-8905364dc026 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:27.491281 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-a2e57619-d13a-4504-b8ef-37c30519fdd2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:27.499019 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-a2e57619-d13a-4504-b8ef-37c30519fdd2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43" status: 200 len: 1557 microversion: 2.1 time: 0.454368 Aug 12 01:30:27.512918 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 177/367] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:27 2022] GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43 => generated 1557 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:27.522844 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-4dc1dfc2-4d10-4fdf-a4bc-261b47c49abb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:27.523402 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-4dc1dfc2-4d10-4fdf-a4bc-261b47c49abb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 0835a143-9929-4018-99dc-2f3e3915fb43] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:27.531374 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4dc1dfc2-4d10-4fdf-a4bc-261b47c49abb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:27.531374 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4dc1dfc2-4d10-4fdf-a4bc-261b47c49abb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:27.531374 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4dc1dfc2-4d10-4fdf-a4bc-261b47c49abb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:27.532723 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4dc1dfc2-4d10-4fdf-a4bc-261b47c49abb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:27.533202 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4dc1dfc2-4d10-4fdf-a4bc-261b47c49abb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:27.533693 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4dc1dfc2-4d10-4fdf-a4bc-261b47c49abb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:27.545168 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-8055c824-1d8f-45da-8abd-8905364dc026 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:27.562573 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-8055c824-1d8f-45da-8abd-8905364dc026 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1721 microversion: 2.1 time: 0.486133 Aug 12 01:30:27.565333 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 191/368] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:27 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1721 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:27.604486 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-7b96b6c8-9cfd-4137-aead-beffee440ace req-16af006c-112e-4e58-b954-b483d5769489 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a", "tag": "dc2ec8af-df9c-48b9-af2f-f3d087bf0f93"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:30:27.618064 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-7b96b6c8-9cfd-4137-aead-beffee440ace req-16af006c-112e-4e58-b954-b483d5769489 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:27.618538 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-7b96b6c8-9cfd-4137-aead-beffee440ace req-16af006c-112e-4e58-b954-b483d5769489 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:27.618969 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-7b96b6c8-9cfd-4137-aead-beffee440ace req-16af006c-112e-4e58-b954-b483d5769489 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:27.635371 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-7b96b6c8-9cfd-4137-aead-beffee440ace req-16af006c-112e-4e58-b954-b483d5769489 service nova] Creating event network-changed:dc2ec8af-df9c-48b9-af2f-f3d087bf0f93 for instance f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a on hv-cinder-78481 Aug 12 01:30:27.642867 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-7b96b6c8-9cfd-4137-aead-beffee440ace req-16af006c-112e-4e58-b954-b483d5769489 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041909 Aug 12 01:30:27.643501 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 192/369] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:30:27.653573 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-be90ba30-094c-4510-a620-56f392b5edb9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:27.654563 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-be90ba30-094c-4510-a620-56f392b5edb9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: a8c75c35-1961-4c9b-9208-ed9096bf447d] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:27.663188 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-be90ba30-094c-4510-a620-56f392b5edb9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:27.664131 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-be90ba30-094c-4510-a620-56f392b5edb9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:27.664646 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-be90ba30-094c-4510-a620-56f392b5edb9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:27.671908 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-be90ba30-094c-4510-a620-56f392b5edb9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:27.672895 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-be90ba30-094c-4510-a620-56f392b5edb9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:27.673655 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-be90ba30-094c-4510-a620-56f392b5edb9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:27.679584 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-4dc1dfc2-4d10-4fdf-a4bc-261b47c49abb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.161420 Aug 12 01:30:27.686299 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 178/370] 10.222.0.20 () {58 vars in 1275 bytes} [Fri Aug 12 01:30:27 2022] GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43/os-interface => generated 284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:30:27.695297 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-8894801e-1da0-4124-915e-25bdfddbff1f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:27.696140 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-8894801e-1da0-4124-915e-25bdfddbff1f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:27.703176 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8894801e-1da0-4124-915e-25bdfddbff1f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:27.703811 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8894801e-1da0-4124-915e-25bdfddbff1f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:27.704689 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8894801e-1da0-4124-915e-25bdfddbff1f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:27.705723 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8894801e-1da0-4124-915e-25bdfddbff1f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:27.707610 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8894801e-1da0-4124-915e-25bdfddbff1f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:27.708311 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8894801e-1da0-4124-915e-25bdfddbff1f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:28.018212 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-8894801e-1da0-4124-915e-25bdfddbff1f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:28.038621 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-8894801e-1da0-4124-915e-25bdfddbff1f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1370 microversion: 2.1 time: 0.350728 Aug 12 01:30:28.042682 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 179/371] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:27 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1370 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:28.056220 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-7d3ef76f-eff4-4900-b43b-423916147811 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:28.058961 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-7d3ef76f-eff4-4900-b43b-423916147811 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: c84abe93-9e47-4be1-b119-e0235ac5b527] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:28.076853 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7d3ef76f-eff4-4900-b43b-423916147811 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:28.077728 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7d3ef76f-eff4-4900-b43b-423916147811 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:28.079059 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7d3ef76f-eff4-4900-b43b-423916147811 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:28.080384 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7d3ef76f-eff4-4900-b43b-423916147811 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:28.081042 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7d3ef76f-eff4-4900-b43b-423916147811 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:28.084386 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7d3ef76f-eff4-4900-b43b-423916147811 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:28.132566 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell1:SELECT=100 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:28.197373 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-be90ba30-094c-4510-a620-56f392b5edb9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:28.209654 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-be90ba30-094c-4510-a620-56f392b5edb9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d" status: 200 len: 1265 microversion: 2.1 time: 0.562467 Aug 12 01:30:28.210422 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 193/372] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:27 2022] GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d => generated 1265 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:30:28.217806 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-76b0c997-4cfb-46f9-8640-d40ce9c9ec8c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:28.234345 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-76b0c997-4cfb-46f9-8640-d40ce9c9ec8c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:28.250414 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-76b0c997-4cfb-46f9-8640-d40ce9c9ec8c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:28.251107 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-76b0c997-4cfb-46f9-8640-d40ce9c9ec8c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:28.252079 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-76b0c997-4cfb-46f9-8640-d40ce9c9ec8c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:28.252982 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-76b0c997-4cfb-46f9-8640-d40ce9c9ec8c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:28.253680 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-76b0c997-4cfb-46f9-8640-d40ce9c9ec8c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:28.254422 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-76b0c997-4cfb-46f9-8640-d40ce9c9ec8c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:28.643286 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-7d3ef76f-eff4-4900-b43b-423916147811 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:28.651296 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-7d3ef76f-eff4-4900-b43b-423916147811 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/c84abe93-9e47-4be1-b119-e0235ac5b527" status: 200 len: 1497 microversion: 2.1 time: 0.607335 Aug 12 01:30:28.651928 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 180/373] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:28 2022] GET /compute/v2.1/servers/c84abe93-9e47-4be1-b119-e0235ac5b527 => generated 1497 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:28.656472 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-86530aef-c6a3-4351-b2d7-e2af32c1ff09 req-048604b1-5a68-4f8e-86a4-e51dde82d480 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8c75c35-1961-4c9b-9208-ed9096bf447d", "name": "network-vif-plugged", "status": "completed", "tag": "de45b233-9e56-4b4c-b5fd-7f356b7e3307"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:30:28.665748 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-86530aef-c6a3-4351-b2d7-e2af32c1ff09 req-048604b1-5a68-4f8e-86a4-e51dde82d480 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:28.666215 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-86530aef-c6a3-4351-b2d7-e2af32c1ff09 req-048604b1-5a68-4f8e-86a4-e51dde82d480 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:28.666605 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-86530aef-c6a3-4351-b2d7-e2af32c1ff09 req-048604b1-5a68-4f8e-86a4-e51dde82d480 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:28.678666 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-86530aef-c6a3-4351-b2d7-e2af32c1ff09 req-048604b1-5a68-4f8e-86a4-e51dde82d480 service nova] Creating event network-vif-plugged:de45b233-9e56-4b4c-b5fd-7f356b7e3307 for instance a8c75c35-1961-4c9b-9208-ed9096bf447d on hv-cinder-78481 Aug 12 01:30:28.681016 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-76b0c997-4cfb-46f9-8640-d40ce9c9ec8c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:28.684116 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-86530aef-c6a3-4351-b2d7-e2af32c1ff09 req-048604b1-5a68-4f8e-86a4-e51dde82d480 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031028 Aug 12 01:30:28.685224 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 181/374] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:30:28.691204 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-154920f7-d214-4923-acad-a4cb859d2ac6 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:28.691904 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-154920f7-d214-4923-acad-a4cb859d2ac6 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:28.698205 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-154920f7-d214-4923-acad-a4cb859d2ac6 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:28.698620 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-76b0c997-4cfb-46f9-8640-d40ce9c9ec8c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:28.699105 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-154920f7-d214-4923-acad-a4cb859d2ac6 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:28.699559 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-154920f7-d214-4923-acad-a4cb859d2ac6 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:28.700375 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-76b0c997-4cfb-46f9-8640-d40ce9c9ec8c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:28.700502 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-154920f7-d214-4923-acad-a4cb859d2ac6 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:28.700661 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-154920f7-d214-4923-acad-a4cb859d2ac6 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:28.701274 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-154920f7-d214-4923-acad-a4cb859d2ac6 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:28.701384 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-76b0c997-4cfb-46f9-8640-d40ce9c9ec8c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1741 microversion: 2.20 time: 0.489743 Aug 12 01:30:28.702141 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 194/375] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:28 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1741 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:30:28.976073 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-154920f7-d214-4923-acad-a4cb859d2ac6 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:28.985046 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-154920f7-d214-4923-acad-a4cb859d2ac6 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1721 microversion: 2.1 time: 0.298446 Aug 12 01:30:28.985752 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 182/376] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:28 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1721 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:29.061523 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-8b1be721-0354-414f-912d-f6d9683c0e82 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:29.062125 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-8b1be721-0354-414f-912d-f6d9683c0e82 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:29.068371 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8b1be721-0354-414f-912d-f6d9683c0e82 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:29.068849 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8b1be721-0354-414f-912d-f6d9683c0e82 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:29.069275 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8b1be721-0354-414f-912d-f6d9683c0e82 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:29.069982 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8b1be721-0354-414f-912d-f6d9683c0e82 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:29.070420 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8b1be721-0354-414f-912d-f6d9683c0e82 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:29.070835 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8b1be721-0354-414f-912d-f6d9683c0e82 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:29.229518 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell0:SELECT=8 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:29.231025 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell0:SELECT=26 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:29.247940 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-379e7e96-7c0e-45bf-b2d7-b8c7be2ad453 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:29.253553 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-379e7e96-7c0e-45bf-b2d7-b8c7be2ad453 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: a8c75c35-1961-4c9b-9208-ed9096bf447d] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:29.261610 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-379e7e96-7c0e-45bf-b2d7-b8c7be2ad453 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:29.262297 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-379e7e96-7c0e-45bf-b2d7-b8c7be2ad453 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:29.262898 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-379e7e96-7c0e-45bf-b2d7-b8c7be2ad453 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:29.263823 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-379e7e96-7c0e-45bf-b2d7-b8c7be2ad453 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:29.264686 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-379e7e96-7c0e-45bf-b2d7-b8c7be2ad453 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:29.265096 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-379e7e96-7c0e-45bf-b2d7-b8c7be2ad453 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:29.655152 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-8b1be721-0354-414f-912d-f6d9683c0e82 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:29.664535 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-8b1be721-0354-414f-912d-f6d9683c0e82 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1370 microversion: 2.1 time: 0.607085 Aug 12 01:30:29.666106 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 195/377] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:29 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1370 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:30:29.672539 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-f796c8d2-6ac1-4de4-b9c5-f4928c2a9436 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:29.673246 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-f796c8d2-6ac1-4de4-b9c5-f4928c2a9436 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: c84abe93-9e47-4be1-b119-e0235ac5b527] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:29.680792 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f796c8d2-6ac1-4de4-b9c5-f4928c2a9436 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:29.681510 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f796c8d2-6ac1-4de4-b9c5-f4928c2a9436 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:29.683298 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f796c8d2-6ac1-4de4-b9c5-f4928c2a9436 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:29.684354 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f796c8d2-6ac1-4de4-b9c5-f4928c2a9436 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:29.685358 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f796c8d2-6ac1-4de4-b9c5-f4928c2a9436 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:29.686254 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f796c8d2-6ac1-4de4-b9c5-f4928c2a9436 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:29.730945 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-f796c8d2-6ac1-4de4-b9c5-f4928c2a9436 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: c84abe93-9e47-4be1-b119-e0235ac5b527] Going to try to terminate instance {{(pid=120786) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 01:30:29.737469 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell1:SELECT=100 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:29.822935 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-f796c8d2-6ac1-4de4-b9c5-f4928c2a9436 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c84abe93-9e47-4be1-b119-e0235ac5b527" status: 204 len: 0 microversion: 2.1 time: 0.154403 Aug 12 01:30:29.823517 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 196/378] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 01:30:29 2022] DELETE /compute/v2.1/servers/c84abe93-9e47-4be1-b119-e0235ac5b527 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 01:30:29.828931 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-691de191-3333-45e9-8aa6-ff995b7b2200 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:29.829650 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-691de191-3333-45e9-8aa6-ff995b7b2200 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:29.835394 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-691de191-3333-45e9-8aa6-ff995b7b2200 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:29.835906 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-691de191-3333-45e9-8aa6-ff995b7b2200 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:29.836334 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-691de191-3333-45e9-8aa6-ff995b7b2200 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:29.836696 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-379e7e96-7c0e-45bf-b2d7-b8c7be2ad453 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:29.837019 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-691de191-3333-45e9-8aa6-ff995b7b2200 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:29.837521 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-691de191-3333-45e9-8aa6-ff995b7b2200 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:29.837935 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-691de191-3333-45e9-8aa6-ff995b7b2200 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:29.845452 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-379e7e96-7c0e-45bf-b2d7-b8c7be2ad453 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d" status: 200 len: 1265 microversion: 2.1 time: 0.617527 Aug 12 01:30:29.846344 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 183/379] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:29 2022] GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d => generated 1265 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:29.852632 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-08c6b073-5ea5-4f70-9da9-751cc9257851 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:29.853446 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-08c6b073-5ea5-4f70-9da9-751cc9257851 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: c84abe93-9e47-4be1-b119-e0235ac5b527] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:29.859615 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-08c6b073-5ea5-4f70-9da9-751cc9257851 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:29.860304 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-08c6b073-5ea5-4f70-9da9-751cc9257851 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:29.860955 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-08c6b073-5ea5-4f70-9da9-751cc9257851 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:29.862149 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-08c6b073-5ea5-4f70-9da9-751cc9257851 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:29.862786 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-08c6b073-5ea5-4f70-9da9-751cc9257851 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:29.863417 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-08c6b073-5ea5-4f70-9da9-751cc9257851 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:30.111651 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-691de191-3333-45e9-8aa6-ff995b7b2200 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:30.115094 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-08c6b073-5ea5-4f70-9da9-751cc9257851 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:30.120112 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-691de191-3333-45e9-8aa6-ff995b7b2200 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:30.121683 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-691de191-3333-45e9-8aa6-ff995b7b2200 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:30.122907 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-08c6b073-5ea5-4f70-9da9-751cc9257851 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/c84abe93-9e47-4be1-b119-e0235ac5b527" status: 200 len: 1503 microversion: 2.1 time: 0.274469 Aug 12 01:30:30.123116 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-691de191-3333-45e9-8aa6-ff995b7b2200 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1723 microversion: 2.20 time: 0.298412 Aug 12 01:30:30.123481 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 184/380] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:29 2022] GET /compute/v2.1/servers/c84abe93-9e47-4be1-b119-e0235ac5b527 => generated 1503 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:30.127875 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-5a0388c5-5189-4a81-ba13-4b7e53d1febd tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:30.139145 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 197/381] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:29 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1723 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:30:30.139145 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-02e3a047-69bf-47bd-8511-9e66786d1233 req-b7aec6b5-de04-431e-978f-d6dd8dab0fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0835a143-9929-4018-99dc-2f3e3915fb43", "tag": "68c71044-03ca-436d-a9ff-d049d4286d64"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:30:30.139866 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-5a0388c5-5189-4a81-ba13-4b7e53d1febd tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:30.145627 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-02e3a047-69bf-47bd-8511-9e66786d1233 req-b7aec6b5-de04-431e-978f-d6dd8dab0fa3 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:30.146504 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-02e3a047-69bf-47bd-8511-9e66786d1233 req-b7aec6b5-de04-431e-978f-d6dd8dab0fa3 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:30.146504 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-02e3a047-69bf-47bd-8511-9e66786d1233 req-b7aec6b5-de04-431e-978f-d6dd8dab0fa3 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:30.147952 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5a0388c5-5189-4a81-ba13-4b7e53d1febd tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:30.148503 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5a0388c5-5189-4a81-ba13-4b7e53d1febd tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:30.148966 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5a0388c5-5189-4a81-ba13-4b7e53d1febd tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:30.149753 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5a0388c5-5189-4a81-ba13-4b7e53d1febd tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:30.150253 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5a0388c5-5189-4a81-ba13-4b7e53d1febd tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:30.150741 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5a0388c5-5189-4a81-ba13-4b7e53d1febd tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:30.158561 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-02e3a047-69bf-47bd-8511-9e66786d1233 req-b7aec6b5-de04-431e-978f-d6dd8dab0fa3 service nova] Creating event network-changed:68c71044-03ca-436d-a9ff-d049d4286d64 for instance 0835a143-9929-4018-99dc-2f3e3915fb43 on hv-cinder-78481 Aug 12 01:30:30.163715 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-02e3a047-69bf-47bd-8511-9e66786d1233 req-b7aec6b5-de04-431e-978f-d6dd8dab0fa3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033815 Aug 12 01:30:30.164415 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 198/382] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:30:30.285329 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-5a0388c5-5189-4a81-ba13-4b7e53d1febd tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:30.293612 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-5a0388c5-5189-4a81-ba13-4b7e53d1febd tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1721 microversion: 2.1 time: 0.169118 Aug 12 01:30:30.294282 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 185/383] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:30 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:30.687959 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-b2dde36c-18d3-4ad8-8bbe-290a3f6943eb tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:30.689287 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-b2dde36c-18d3-4ad8-8bbe-290a3f6943eb tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:30.695950 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b2dde36c-18d3-4ad8-8bbe-290a3f6943eb tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:30.696439 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b2dde36c-18d3-4ad8-8bbe-290a3f6943eb tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:30.696879 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b2dde36c-18d3-4ad8-8bbe-290a3f6943eb tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:30.697592 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b2dde36c-18d3-4ad8-8bbe-290a3f6943eb tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:30.698067 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b2dde36c-18d3-4ad8-8bbe-290a3f6943eb tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:30.698505 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b2dde36c-18d3-4ad8-8bbe-290a3f6943eb tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:30.839915 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-b2dde36c-18d3-4ad8-8bbe-290a3f6943eb tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:30.847833 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-b2dde36c-18d3-4ad8-8bbe-290a3f6943eb tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1370 microversion: 2.1 time: 0.164639 Aug 12 01:30:30.848549 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 199/384] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:30 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:30.866357 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-fc261b34-5254-4e98-af33-bfbabac1ad67 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:30.866972 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-fc261b34-5254-4e98-af33-bfbabac1ad67 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: a8c75c35-1961-4c9b-9208-ed9096bf447d] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:30.873263 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-fc261b34-5254-4e98-af33-bfbabac1ad67 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:30.873747 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-fc261b34-5254-4e98-af33-bfbabac1ad67 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:30.874171 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-fc261b34-5254-4e98-af33-bfbabac1ad67 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:30.874860 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-fc261b34-5254-4e98-af33-bfbabac1ad67 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:30.875301 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-fc261b34-5254-4e98-af33-bfbabac1ad67 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:30.875772 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-fc261b34-5254-4e98-af33-bfbabac1ad67 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:31.010035 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-fc261b34-5254-4e98-af33-bfbabac1ad67 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:31.018097 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-fc261b34-5254-4e98-af33-bfbabac1ad67 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d" status: 200 len: 1265 microversion: 2.1 time: 0.155535 Aug 12 01:30:31.018645 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 186/385] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:30 2022] GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:31.143935 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-d0a2ed8e-8d7e-418e-9682-ade1f381e3f9 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:31.144523 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-d0a2ed8e-8d7e-418e-9682-ade1f381e3f9 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: c84abe93-9e47-4be1-b119-e0235ac5b527] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:31.150483 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-f6a95281-866e-4aa6-9daf-a3ba66e77925 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:31.151177 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-f6a95281-866e-4aa6-9daf-a3ba66e77925 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:31.151338 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d0a2ed8e-8d7e-418e-9682-ade1f381e3f9 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:31.151727 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d0a2ed8e-8d7e-418e-9682-ade1f381e3f9 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:31.152156 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d0a2ed8e-8d7e-418e-9682-ade1f381e3f9 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:31.152860 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d0a2ed8e-8d7e-418e-9682-ade1f381e3f9 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:31.153330 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d0a2ed8e-8d7e-418e-9682-ade1f381e3f9 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:31.153846 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d0a2ed8e-8d7e-418e-9682-ade1f381e3f9 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:31.159776 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f6a95281-866e-4aa6-9daf-a3ba66e77925 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:31.160261 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f6a95281-866e-4aa6-9daf-a3ba66e77925 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:31.160685 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f6a95281-866e-4aa6-9daf-a3ba66e77925 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:31.161382 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f6a95281-866e-4aa6-9daf-a3ba66e77925 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:31.161810 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f6a95281-866e-4aa6-9daf-a3ba66e77925 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:31.162305 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f6a95281-866e-4aa6-9daf-a3ba66e77925 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:31.403156 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-d0a2ed8e-8d7e-418e-9682-ade1f381e3f9 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:31.411162 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-d0a2ed8e-8d7e-418e-9682-ade1f381e3f9 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/c84abe93-9e47-4be1-b119-e0235ac5b527" status: 200 len: 1503 microversion: 2.1 time: 0.271240 Aug 12 01:30:31.411869 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 200/386] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:31 2022] GET /compute/v2.1/servers/c84abe93-9e47-4be1-b119-e0235ac5b527 => generated 1503 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:31.416722 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-7888273a-a6b3-45fa-8403-bb2e1fb944ae tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:31.417326 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-7888273a-a6b3-45fa-8403-bb2e1fb944ae tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:31.419688 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-f6a95281-866e-4aa6-9daf-a3ba66e77925 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:31.423259 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7888273a-a6b3-45fa-8403-bb2e1fb944ae tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:31.423787 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7888273a-a6b3-45fa-8403-bb2e1fb944ae tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:31.424229 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7888273a-a6b3-45fa-8403-bb2e1fb944ae tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:31.425052 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7888273a-a6b3-45fa-8403-bb2e1fb944ae tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:31.426397 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7888273a-a6b3-45fa-8403-bb2e1fb944ae tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:31.426836 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7888273a-a6b3-45fa-8403-bb2e1fb944ae tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:31.439196 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-f6a95281-866e-4aa6-9daf-a3ba66e77925 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:31.441190 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-f6a95281-866e-4aa6-9daf-a3ba66e77925 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:31.442352 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-f6a95281-866e-4aa6-9daf-a3ba66e77925 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1723 microversion: 2.20 time: 0.295915 Aug 12 01:30:31.442940 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 187/387] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:31 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1723 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:30:31.563512 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-7888273a-a6b3-45fa-8403-bb2e1fb944ae tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:31.571879 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-7888273a-a6b3-45fa-8403-bb2e1fb944ae tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1721 microversion: 2.1 time: 0.159018 Aug 12 01:30:31.572471 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 201/388] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:31 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:31.873104 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-4882affb-3cdd-4a1d-8547-e11231b75538 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:31.874075 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-4882affb-3cdd-4a1d-8547-e11231b75538 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:31.881344 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4882affb-3cdd-4a1d-8547-e11231b75538 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:31.881817 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4882affb-3cdd-4a1d-8547-e11231b75538 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:31.882247 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4882affb-3cdd-4a1d-8547-e11231b75538 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:31.882920 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4882affb-3cdd-4a1d-8547-e11231b75538 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:31.883362 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4882affb-3cdd-4a1d-8547-e11231b75538 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:31.883810 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4882affb-3cdd-4a1d-8547-e11231b75538 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:32.020223 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-4882affb-3cdd-4a1d-8547-e11231b75538 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:32.028020 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-4882affb-3cdd-4a1d-8547-e11231b75538 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1370 microversion: 2.1 time: 0.161390 Aug 12 01:30:32.028623 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 188/389] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:31 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:32.046903 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-d565e4c7-2fcd-4b47-b346-d93759ef1d32 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:32.047818 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-d565e4c7-2fcd-4b47-b346-d93759ef1d32 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: a8c75c35-1961-4c9b-9208-ed9096bf447d] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:32.054279 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d565e4c7-2fcd-4b47-b346-d93759ef1d32 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:32.054761 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d565e4c7-2fcd-4b47-b346-d93759ef1d32 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:32.055506 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d565e4c7-2fcd-4b47-b346-d93759ef1d32 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:32.056216 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d565e4c7-2fcd-4b47-b346-d93759ef1d32 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:32.056654 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d565e4c7-2fcd-4b47-b346-d93759ef1d32 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:32.057067 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d565e4c7-2fcd-4b47-b346-d93759ef1d32 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:32.164442 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-2a091da3-78f5-4afe-8337-303133eb2e75 req-11e0083b-be2e-4877-acea-63064ee92bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ed5ced2-87ad-4d0f-860c-648bcca91ca8", "name": "network-vif-unplugged", "status": "completed", "tag": "476d0433-5310-435b-93ea-c42ed83c3136"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:30:32.174651 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-2a091da3-78f5-4afe-8337-303133eb2e75 req-11e0083b-be2e-4877-acea-63064ee92bf1 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:32.175256 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-2a091da3-78f5-4afe-8337-303133eb2e75 req-11e0083b-be2e-4877-acea-63064ee92bf1 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:32.175806 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-2a091da3-78f5-4afe-8337-303133eb2e75 req-11e0083b-be2e-4877-acea-63064ee92bf1 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:32.188628 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-2a091da3-78f5-4afe-8337-303133eb2e75 req-11e0083b-be2e-4877-acea-63064ee92bf1 service nova] Creating event network-vif-unplugged:476d0433-5310-435b-93ea-c42ed83c3136 for instance 0ed5ced2-87ad-4d0f-860c-648bcca91ca8 on hv-cinder-78481 Aug 12 01:30:32.194022 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-2a091da3-78f5-4afe-8337-303133eb2e75 req-11e0083b-be2e-4877-acea-63064ee92bf1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033426 Aug 12 01:30:32.194912 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 189/390] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:30:32.204898 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-d565e4c7-2fcd-4b47-b346-d93759ef1d32 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:32.212560 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-d565e4c7-2fcd-4b47-b346-d93759ef1d32 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d" status: 200 len: 1265 microversion: 2.1 time: 0.169546 Aug 12 01:30:32.213371 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 202/391] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:32 2022] GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:32.437947 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-133306ef-ffb4-4537-bdab-58ecb9e5809e tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:32.439391 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-133306ef-ffb4-4537-bdab-58ecb9e5809e tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: c84abe93-9e47-4be1-b119-e0235ac5b527] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:32.449896 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-133306ef-ffb4-4537-bdab-58ecb9e5809e tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:32.450683 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-133306ef-ffb4-4537-bdab-58ecb9e5809e tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:32.451385 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-133306ef-ffb4-4537-bdab-58ecb9e5809e tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:32.452540 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-133306ef-ffb4-4537-bdab-58ecb9e5809e tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:32.453275 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-133306ef-ffb4-4537-bdab-58ecb9e5809e tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:32.453964 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-133306ef-ffb4-4537-bdab-58ecb9e5809e tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:32.464746 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-317de953-7c88-461a-8f4a-cedad2f20846 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:32.465348 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-317de953-7c88-461a-8f4a-cedad2f20846 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:32.471582 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-317de953-7c88-461a-8f4a-cedad2f20846 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:32.472093 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-317de953-7c88-461a-8f4a-cedad2f20846 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:32.472529 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-317de953-7c88-461a-8f4a-cedad2f20846 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:32.473231 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-317de953-7c88-461a-8f4a-cedad2f20846 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:32.473636 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-317de953-7c88-461a-8f4a-cedad2f20846 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:32.474069 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-317de953-7c88-461a-8f4a-cedad2f20846 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:32.661434 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-133306ef-ffb4-4537-bdab-58ecb9e5809e tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:32.666478 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-317de953-7c88-461a-8f4a-cedad2f20846 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:32.674224 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-133306ef-ffb4-4537-bdab-58ecb9e5809e tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/c84abe93-9e47-4be1-b119-e0235ac5b527" status: 200 len: 1503 microversion: 2.1 time: 0.244050 Aug 12 01:30:32.677494 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 190/392] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:32 2022] GET /compute/v2.1/servers/c84abe93-9e47-4be1-b119-e0235ac5b527 => generated 1503 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:32.679094 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-317de953-7c88-461a-8f4a-cedad2f20846 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:32.679411 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-3b32361f-1281-409f-a467-8ae498fff42d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:32.680353 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-3b32361f-1281-409f-a467-8ae498fff42d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:32.680957 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-317de953-7c88-461a-8f4a-cedad2f20846 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:32.682139 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-317de953-7c88-461a-8f4a-cedad2f20846 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1723 microversion: 2.20 time: 0.221342 Aug 12 01:30:32.686372 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3b32361f-1281-409f-a467-8ae498fff42d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:32.686855 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3b32361f-1281-409f-a467-8ae498fff42d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:32.687525 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3b32361f-1281-409f-a467-8ae498fff42d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:32.688327 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3b32361f-1281-409f-a467-8ae498fff42d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:32.688797 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3b32361f-1281-409f-a467-8ae498fff42d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:32.689274 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3b32361f-1281-409f-a467-8ae498fff42d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:32.693767 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 203/393] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:32 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:30:32.822633 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-3b32361f-1281-409f-a467-8ae498fff42d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:32.830630 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-3b32361f-1281-409f-a467-8ae498fff42d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1721 microversion: 2.1 time: 0.154890 Aug 12 01:30:32.831192 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 191/394] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:32 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:33.050364 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-59a34eb1-4af4-4631-a3c3-5d7dca21e494 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:33.050921 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-59a34eb1-4af4-4631-a3c3-5d7dca21e494 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:33.057600 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-59a34eb1-4af4-4631-a3c3-5d7dca21e494 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:33.058086 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-59a34eb1-4af4-4631-a3c3-5d7dca21e494 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:33.058517 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-59a34eb1-4af4-4631-a3c3-5d7dca21e494 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:33.059213 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-59a34eb1-4af4-4631-a3c3-5d7dca21e494 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:33.059688 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-59a34eb1-4af4-4631-a3c3-5d7dca21e494 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:33.060154 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-59a34eb1-4af4-4631-a3c3-5d7dca21e494 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:33.206244 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-59a34eb1-4af4-4631-a3c3-5d7dca21e494 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:33.215166 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-59a34eb1-4af4-4631-a3c3-5d7dca21e494 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1370 microversion: 2.1 time: 0.169284 Aug 12 01:30:33.215785 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 204/395] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:33 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:33.233439 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-c1ffb19b-745f-4504-a6fe-68b2f2671121 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:33.234049 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-c1ffb19b-745f-4504-a6fe-68b2f2671121 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: a8c75c35-1961-4c9b-9208-ed9096bf447d] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:33.241652 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c1ffb19b-745f-4504-a6fe-68b2f2671121 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:33.242239 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c1ffb19b-745f-4504-a6fe-68b2f2671121 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:33.242773 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c1ffb19b-745f-4504-a6fe-68b2f2671121 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:33.244744 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c1ffb19b-745f-4504-a6fe-68b2f2671121 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:33.245590 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c1ffb19b-745f-4504-a6fe-68b2f2671121 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:33.247578 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c1ffb19b-745f-4504-a6fe-68b2f2671121 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:33.395507 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-c1ffb19b-745f-4504-a6fe-68b2f2671121 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:33.403811 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-c1ffb19b-745f-4504-a6fe-68b2f2671121 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d" status: 200 len: 1265 microversion: 2.1 time: 0.174167 Aug 12 01:30:33.404369 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 192/396] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:33 2022] GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:33.699461 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-974dc3e5-10a4-41e7-93e9-5833ede3e1a6 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:33.708383 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-32144bba-876d-4dcf-8bc5-ec7450bce057 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:33.711288 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-974dc3e5-10a4-41e7-93e9-5833ede3e1a6 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: c84abe93-9e47-4be1-b119-e0235ac5b527] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:33.711632 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-32144bba-876d-4dcf-8bc5-ec7450bce057 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:33.736064 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-974dc3e5-10a4-41e7-93e9-5833ede3e1a6 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:33.736560 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-974dc3e5-10a4-41e7-93e9-5833ede3e1a6 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:33.738404 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-974dc3e5-10a4-41e7-93e9-5833ede3e1a6 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:33.739609 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-974dc3e5-10a4-41e7-93e9-5833ede3e1a6 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:33.739749 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-32144bba-876d-4dcf-8bc5-ec7450bce057 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:33.740171 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-32144bba-876d-4dcf-8bc5-ec7450bce057 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:33.740613 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-32144bba-876d-4dcf-8bc5-ec7450bce057 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:33.741193 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-974dc3e5-10a4-41e7-93e9-5833ede3e1a6 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:33.741370 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-32144bba-876d-4dcf-8bc5-ec7450bce057 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:33.741631 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-974dc3e5-10a4-41e7-93e9-5833ede3e1a6 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:33.741825 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-32144bba-876d-4dcf-8bc5-ec7450bce057 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:33.742253 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-32144bba-876d-4dcf-8bc5-ec7450bce057 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:34.082266 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-32144bba-876d-4dcf-8bc5-ec7450bce057 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:34.087506 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-974dc3e5-10a4-41e7-93e9-5833ede3e1a6 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:34.095134 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-32144bba-876d-4dcf-8bc5-ec7450bce057 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:34.097103 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-32144bba-876d-4dcf-8bc5-ec7450bce057 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:34.098702 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-32144bba-876d-4dcf-8bc5-ec7450bce057 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1723 microversion: 2.20 time: 0.395948 Aug 12 01:30:34.099469 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 193/397] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:33 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1723 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:30:34.104666 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-ff0baab3-76e0-49a7-97e1-b61712bd382d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:34.105494 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-ff0baab3-76e0-49a7-97e1-b61712bd382d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:34.111695 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ff0baab3-76e0-49a7-97e1-b61712bd382d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:34.112362 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ff0baab3-76e0-49a7-97e1-b61712bd382d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:34.112972 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ff0baab3-76e0-49a7-97e1-b61712bd382d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:34.113814 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ff0baab3-76e0-49a7-97e1-b61712bd382d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:34.114407 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ff0baab3-76e0-49a7-97e1-b61712bd382d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:34.114986 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ff0baab3-76e0-49a7-97e1-b61712bd382d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:34.118365 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-974dc3e5-10a4-41e7-93e9-5833ede3e1a6 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/c84abe93-9e47-4be1-b119-e0235ac5b527" status: 200 len: 1503 microversion: 2.1 time: 0.423505 Aug 12 01:30:34.119056 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 205/398] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:33 2022] GET /compute/v2.1/servers/c84abe93-9e47-4be1-b119-e0235ac5b527 => generated 1503 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:34.212270 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-6ccd2347-98b4-4822-bd7e-6c7de13e6c6d req-ccc4d673-a618-4645-b832-766d90d80846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a", "name": "network-vif-plugged", "status": "completed", "tag": "dc2ec8af-df9c-48b9-af2f-f3d087bf0f93"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:30:34.238426 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-6ccd2347-98b4-4822-bd7e-6c7de13e6c6d req-ccc4d673-a618-4645-b832-766d90d80846 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:34.241563 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-6ccd2347-98b4-4822-bd7e-6c7de13e6c6d req-ccc4d673-a618-4645-b832-766d90d80846 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:34.242016 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-6ccd2347-98b4-4822-bd7e-6c7de13e6c6d req-ccc4d673-a618-4645-b832-766d90d80846 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:34.262422 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-6ccd2347-98b4-4822-bd7e-6c7de13e6c6d req-ccc4d673-a618-4645-b832-766d90d80846 service nova] Creating event network-vif-plugged:dc2ec8af-df9c-48b9-af2f-f3d087bf0f93 for instance f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a on hv-cinder-78481 Aug 12 01:30:34.268066 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-6ccd2347-98b4-4822-bd7e-6c7de13e6c6d req-ccc4d673-a618-4645-b832-766d90d80846 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060872 Aug 12 01:30:34.268731 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 206/399] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 01:30:34.270084 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-ff0baab3-76e0-49a7-97e1-b61712bd382d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:34.273730 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-ab1a0835-6447-4bd6-8aec-9598762d7ebc tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:34.274598 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-ab1a0835-6447-4bd6-8aec-9598762d7ebc tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:34.278291 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-ff0baab3-76e0-49a7-97e1-b61712bd382d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1698 microversion: 2.1 time: 0.177673 Aug 12 01:30:34.278863 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 194/400] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:34 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1698 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:34.280877 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ab1a0835-6447-4bd6-8aec-9598762d7ebc tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:34.281349 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ab1a0835-6447-4bd6-8aec-9598762d7ebc tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:34.281773 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ab1a0835-6447-4bd6-8aec-9598762d7ebc tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:34.282544 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ab1a0835-6447-4bd6-8aec-9598762d7ebc tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:34.282987 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ab1a0835-6447-4bd6-8aec-9598762d7ebc tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:34.283400 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ab1a0835-6447-4bd6-8aec-9598762d7ebc tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:34.298736 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-37202236-76af-4c9e-b5cc-ef08eb0bf90f tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:30:34.306448 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-37202236-76af-4c9e-b5cc-ef08eb0bf90f tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:34.306934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-37202236-76af-4c9e-b5cc-ef08eb0bf90f tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:34.307363 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-37202236-76af-4c9e-b5cc-ef08eb0bf90f tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:34.336098 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-37202236-76af-4c9e-b5cc-ef08eb0bf90f tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Going to try to start instance {{(pid=120785) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 12 01:30:34.390696 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-37202236-76af-4c9e-b5cc-ef08eb0bf90f tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "POST /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a/action" status: 202 len: 0 microversion: 2.1 time: 0.095761 Aug 12 01:30:34.391668 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 195/401] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Aug 12 01:30:34 2022] POST /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 12 01:30:34.401513 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-b1f6b8bd-0638-4c77-b8de-f98c8fb19ac0 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:34.403057 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-b1f6b8bd-0638-4c77-b8de-f98c8fb19ac0 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:34.409909 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b1f6b8bd-0638-4c77-b8de-f98c8fb19ac0 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:34.410468 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b1f6b8bd-0638-4c77-b8de-f98c8fb19ac0 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:34.410958 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b1f6b8bd-0638-4c77-b8de-f98c8fb19ac0 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:34.411905 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b1f6b8bd-0638-4c77-b8de-f98c8fb19ac0 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:34.412776 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b1f6b8bd-0638-4c77-b8de-f98c8fb19ac0 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:34.413231 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b1f6b8bd-0638-4c77-b8de-f98c8fb19ac0 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:34.544438 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-ab1a0835-6447-4bd6-8aec-9598762d7ebc tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:34.552332 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-ab1a0835-6447-4bd6-8aec-9598762d7ebc tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1370 microversion: 2.1 time: 0.282424 Aug 12 01:30:34.552914 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 207/402] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:34 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1370 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:34.571549 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-d9ea43ea-10a2-438b-b1b3-a10bb7cbd027 req-cf47ae6f-b24d-4254-a154-98195c1221c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c84abe93-9e47-4be1-b119-e0235ac5b527", "name": "network-vif-deleted", "tag": "f4846636-61a2-4509-8815-c5875736aae6"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:30:34.581259 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-d9ea43ea-10a2-438b-b1b3-a10bb7cbd027 req-cf47ae6f-b24d-4254-a154-98195c1221c7 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:34.582464 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-d9ea43ea-10a2-438b-b1b3-a10bb7cbd027 req-cf47ae6f-b24d-4254-a154-98195c1221c7 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:34.582464 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-d9ea43ea-10a2-438b-b1b3-a10bb7cbd027 req-cf47ae6f-b24d-4254-a154-98195c1221c7 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:34.595242 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-d9ea43ea-10a2-438b-b1b3-a10bb7cbd027 req-cf47ae6f-b24d-4254-a154-98195c1221c7 service nova] Creating event network-vif-deleted:f4846636-61a2-4509-8815-c5875736aae6 for instance c84abe93-9e47-4be1-b119-e0235ac5b527 on hv-cinder-78481 Aug 12 01:30:34.600061 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-d9ea43ea-10a2-438b-b1b3-a10bb7cbd027 req-cf47ae6f-b24d-4254-a154-98195c1221c7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032241 Aug 12 01:30:34.601053 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 208/403] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:30:34.606251 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-5f4ab189-0c1f-41a6-a009-5160ed95b0c3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:34.606934 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-5f4ab189-0c1f-41a6-a009-5160ed95b0c3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: a8c75c35-1961-4c9b-9208-ed9096bf447d] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:34.613487 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5f4ab189-0c1f-41a6-a009-5160ed95b0c3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:34.613952 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5f4ab189-0c1f-41a6-a009-5160ed95b0c3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:34.614430 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5f4ab189-0c1f-41a6-a009-5160ed95b0c3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:34.615193 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5f4ab189-0c1f-41a6-a009-5160ed95b0c3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:34.615711 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5f4ab189-0c1f-41a6-a009-5160ed95b0c3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:34.616200 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5f4ab189-0c1f-41a6-a009-5160ed95b0c3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:34.799518 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-b1f6b8bd-0638-4c77-b8de-f98c8fb19ac0 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:34.808366 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-b1f6b8bd-0638-4c77-b8de-f98c8fb19ac0 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1707 microversion: 2.1 time: 0.411386 Aug 12 01:30:34.808983 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 196/404] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:34 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1707 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:34.830974 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-5f4ab189-0c1f-41a6-a009-5160ed95b0c3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:34.839353 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-5f4ab189-0c1f-41a6-a009-5160ed95b0c3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d" status: 200 len: 1452 microversion: 2.1 time: 0.237177 Aug 12 01:30:34.839967 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 209/405] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:34 2022] GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d => generated 1452 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:34.865368 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-cbf7de6b-a0e2-48f4-b8d9-69cbdd9673bb tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:34.866302 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-cbf7de6b-a0e2-48f4-b8d9-69cbdd9673bb tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: a8c75c35-1961-4c9b-9208-ed9096bf447d] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:34.875519 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cbf7de6b-a0e2-48f4-b8d9-69cbdd9673bb tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:34.876360 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cbf7de6b-a0e2-48f4-b8d9-69cbdd9673bb tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:34.876796 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cbf7de6b-a0e2-48f4-b8d9-69cbdd9673bb tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:34.877487 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cbf7de6b-a0e2-48f4-b8d9-69cbdd9673bb tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:34.877933 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cbf7de6b-a0e2-48f4-b8d9-69cbdd9673bb tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:34.878359 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cbf7de6b-a0e2-48f4-b8d9-69cbdd9673bb tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:34.896683 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:35.017310 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-cbf7de6b-a0e2-48f4-b8d9-69cbdd9673bb tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:35.028133 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-cbf7de6b-a0e2-48f4-b8d9-69cbdd9673bb tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d" status: 200 len: 1452 microversion: 2.1 time: 0.168242 Aug 12 01:30:35.028963 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 197/406] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:34 2022] GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d => generated 1452 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:35.122556 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-4468040a-1f5c-47ce-a79c-ae34dba27c00 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:35.123284 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-4468040a-1f5c-47ce-a79c-ae34dba27c00 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:35.130240 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4468040a-1f5c-47ce-a79c-ae34dba27c00 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:35.130807 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4468040a-1f5c-47ce-a79c-ae34dba27c00 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:35.131332 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4468040a-1f5c-47ce-a79c-ae34dba27c00 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:35.132067 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4468040a-1f5c-47ce-a79c-ae34dba27c00 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:35.134104 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4468040a-1f5c-47ce-a79c-ae34dba27c00 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:35.134561 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4468040a-1f5c-47ce-a79c-ae34dba27c00 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:35.139324 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-a80f18f2-2fdf-4e51-a3d1-a08a22db4fd4 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:35.140048 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-a80f18f2-2fdf-4e51-a3d1-a08a22db4fd4 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: c84abe93-9e47-4be1-b119-e0235ac5b527] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:35.145980 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a80f18f2-2fdf-4e51-a3d1-a08a22db4fd4 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:35.146450 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a80f18f2-2fdf-4e51-a3d1-a08a22db4fd4 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:35.146896 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a80f18f2-2fdf-4e51-a3d1-a08a22db4fd4 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:35.147611 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a80f18f2-2fdf-4e51-a3d1-a08a22db4fd4 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:35.148069 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a80f18f2-2fdf-4e51-a3d1-a08a22db4fd4 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:35.148484 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a80f18f2-2fdf-4e51-a3d1-a08a22db4fd4 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:35.181187 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a80f18f2-2fdf-4e51-a3d1-a08a22db4fd4 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:35.181667 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a80f18f2-2fdf-4e51-a3d1-a08a22db4fd4 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:35.182093 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a80f18f2-2fdf-4e51-a3d1-a08a22db4fd4 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:35.183572 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.objects.instance [None req-a80f18f2-2fdf-4e51-a3d1-a08a22db4fd4 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lazy-loading 'fault' on Instance uuid c84abe93-9e47-4be1-b119-e0235ac5b527 {{(pid=120785) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 01:30:35.236796 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-a80f18f2-2fdf-4e51-a3d1-a08a22db4fd4 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:35.246607 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-a80f18f2-2fdf-4e51-a3d1-a08a22db4fd4 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/c84abe93-9e47-4be1-b119-e0235ac5b527" status: 200 len: 1303 microversion: 2.1 time: 0.111034 Aug 12 01:30:35.247334 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 198/407] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:35 2022] GET /compute/v2.1/servers/c84abe93-9e47-4be1-b119-e0235ac5b527 => generated 1303 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:30:35.298620 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-4468040a-1f5c-47ce-a79c-ae34dba27c00 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:35.307494 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-4468040a-1f5c-47ce-a79c-ae34dba27c00 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:35.309016 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-4468040a-1f5c-47ce-a79c-ae34dba27c00 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:35.310188 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-4468040a-1f5c-47ce-a79c-ae34dba27c00 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1723 microversion: 2.20 time: 0.191677 Aug 12 01:30:35.310754 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 210/408] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:35 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:30:35.574042 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-b2dcefea-0d78-4073-a6a2-6a70457d33a3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:35.574646 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-b2dcefea-0d78-4073-a6a2-6a70457d33a3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:35.580663 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b2dcefea-0d78-4073-a6a2-6a70457d33a3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:35.581129 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b2dcefea-0d78-4073-a6a2-6a70457d33a3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:35.581561 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b2dcefea-0d78-4073-a6a2-6a70457d33a3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:35.582237 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b2dcefea-0d78-4073-a6a2-6a70457d33a3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:35.582673 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b2dcefea-0d78-4073-a6a2-6a70457d33a3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:35.583084 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b2dcefea-0d78-4073-a6a2-6a70457d33a3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:35.720180 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-b2dcefea-0d78-4073-a6a2-6a70457d33a3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:35.728206 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-b2dcefea-0d78-4073-a6a2-6a70457d33a3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1370 microversion: 2.1 time: 0.158183 Aug 12 01:30:35.728773 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 199/409] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:35 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:35.830027 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-d584301b-d3b8-4033-9a77-44abf69a380f tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:35.830556 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-d584301b-d3b8-4033-9a77-44abf69a380f tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:35.837053 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d584301b-d3b8-4033-9a77-44abf69a380f tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:35.837760 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d584301b-d3b8-4033-9a77-44abf69a380f tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:35.838203 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d584301b-d3b8-4033-9a77-44abf69a380f tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:35.838863 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d584301b-d3b8-4033-9a77-44abf69a380f tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:35.839341 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d584301b-d3b8-4033-9a77-44abf69a380f tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:35.839945 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d584301b-d3b8-4033-9a77-44abf69a380f tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:35.974759 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-d584301b-d3b8-4033-9a77-44abf69a380f tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:35.982606 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-d584301b-d3b8-4033-9a77-44abf69a380f tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1707 microversion: 2.1 time: 0.156675 Aug 12 01:30:35.983176 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 211/410] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:35 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1707 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:36.268652 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-2d162912-93b4-46eb-9492-b7fdbfccdcac tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:36.269254 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-2d162912-93b4-46eb-9492-b7fdbfccdcac tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: c84abe93-9e47-4be1-b119-e0235ac5b527] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:36.275407 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2d162912-93b4-46eb-9492-b7fdbfccdcac tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:36.275936 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2d162912-93b4-46eb-9492-b7fdbfccdcac tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:36.276339 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2d162912-93b4-46eb-9492-b7fdbfccdcac tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:36.277022 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2d162912-93b4-46eb-9492-b7fdbfccdcac tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:36.277462 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2d162912-93b4-46eb-9492-b7fdbfccdcac tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:36.277871 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2d162912-93b4-46eb-9492-b7fdbfccdcac tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:36.310141 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2d162912-93b4-46eb-9492-b7fdbfccdcac tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:36.310612 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2d162912-93b4-46eb-9492-b7fdbfccdcac tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:36.311025 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2d162912-93b4-46eb-9492-b7fdbfccdcac tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:36.311464 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.objects.instance [None req-2d162912-93b4-46eb-9492-b7fdbfccdcac tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lazy-loading 'fault' on Instance uuid c84abe93-9e47-4be1-b119-e0235ac5b527 {{(pid=120785) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 01:30:36.332886 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-35e004f6-3579-471c-a198-7354a4ac4873 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:36.333478 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-35e004f6-3579-471c-a198-7354a4ac4873 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:36.340406 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-35e004f6-3579-471c-a198-7354a4ac4873 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:36.341185 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-35e004f6-3579-471c-a198-7354a4ac4873 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:36.341804 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-35e004f6-3579-471c-a198-7354a4ac4873 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:36.342506 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-35e004f6-3579-471c-a198-7354a4ac4873 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:36.342954 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-35e004f6-3579-471c-a198-7354a4ac4873 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:36.343372 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-35e004f6-3579-471c-a198-7354a4ac4873 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:36.361449 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-2d162912-93b4-46eb-9492-b7fdbfccdcac tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:36.370325 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-2d162912-93b4-46eb-9492-b7fdbfccdcac tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/c84abe93-9e47-4be1-b119-e0235ac5b527" status: 200 len: 1303 microversion: 2.1 time: 0.105682 Aug 12 01:30:36.371194 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 200/411] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:36 2022] GET /compute/v2.1/servers/c84abe93-9e47-4be1-b119-e0235ac5b527 => generated 1303 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:36.500775 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-35e004f6-3579-471c-a198-7354a4ac4873 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:36.509480 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-35e004f6-3579-471c-a198-7354a4ac4873 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:36.511080 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-35e004f6-3579-471c-a198-7354a4ac4873 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:36.512279 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-35e004f6-3579-471c-a198-7354a4ac4873 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1723 microversion: 2.20 time: 0.183407 Aug 12 01:30:36.512850 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 212/412] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:36 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 01:30:36.749446 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-bcbe7787-2948-4b97-b98a-ce02cb42a698 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:36.750977 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-bcbe7787-2948-4b97-b98a-ce02cb42a698 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:36.760469 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bcbe7787-2948-4b97-b98a-ce02cb42a698 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:36.761314 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bcbe7787-2948-4b97-b98a-ce02cb42a698 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:36.761900 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bcbe7787-2948-4b97-b98a-ce02cb42a698 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:36.762762 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bcbe7787-2948-4b97-b98a-ce02cb42a698 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:36.763549 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bcbe7787-2948-4b97-b98a-ce02cb42a698 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:36.764113 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bcbe7787-2948-4b97-b98a-ce02cb42a698 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:36.911992 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-c1c9bfed-d4f8-4c05-8ae9-f4b93abfa1b2 req-2c26e16a-8e5b-4a08-9397-a05dc4fb673f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8c75c35-1961-4c9b-9208-ed9096bf447d", "tag": "de45b233-9e56-4b4c-b5fd-7f356b7e3307"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:30:36.923692 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-c1c9bfed-d4f8-4c05-8ae9-f4b93abfa1b2 req-2c26e16a-8e5b-4a08-9397-a05dc4fb673f service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:36.924161 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-c1c9bfed-d4f8-4c05-8ae9-f4b93abfa1b2 req-2c26e16a-8e5b-4a08-9397-a05dc4fb673f service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:36.924581 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-c1c9bfed-d4f8-4c05-8ae9-f4b93abfa1b2 req-2c26e16a-8e5b-4a08-9397-a05dc4fb673f service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:36.936701 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-c1c9bfed-d4f8-4c05-8ae9-f4b93abfa1b2 req-2c26e16a-8e5b-4a08-9397-a05dc4fb673f service nova] Creating event network-changed:de45b233-9e56-4b4c-b5fd-7f356b7e3307 for instance a8c75c35-1961-4c9b-9208-ed9096bf447d on hv-cinder-78481 Aug 12 01:30:36.942167 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-c1c9bfed-d4f8-4c05-8ae9-f4b93abfa1b2 req-2c26e16a-8e5b-4a08-9397-a05dc4fb673f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034992 Aug 12 01:30:36.943067 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 213/413] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:30:36.987054 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-bcbe7787-2948-4b97-b98a-ce02cb42a698 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:36.996080 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-bcbe7787-2948-4b97-b98a-ce02cb42a698 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1370 microversion: 2.1 time: 0.249745 Aug 12 01:30:36.996985 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 201/414] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:36 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1370 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:37.004909 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-5ac5aa0d-13a5-46d1-8ae7-2b350b920441 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:37.005765 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-5ac5aa0d-13a5-46d1-8ae7-2b350b920441 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:37.012102 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5ac5aa0d-13a5-46d1-8ae7-2b350b920441 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:37.012658 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5ac5aa0d-13a5-46d1-8ae7-2b350b920441 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:37.013190 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5ac5aa0d-13a5-46d1-8ae7-2b350b920441 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:37.013952 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5ac5aa0d-13a5-46d1-8ae7-2b350b920441 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:37.014463 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5ac5aa0d-13a5-46d1-8ae7-2b350b920441 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:37.014946 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5ac5aa0d-13a5-46d1-8ae7-2b350b920441 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:37.033003 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:37.212501 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-5ac5aa0d-13a5-46d1-8ae7-2b350b920441 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:37.221374 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-5ac5aa0d-13a5-46d1-8ae7-2b350b920441 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1707 microversion: 2.1 time: 0.220815 Aug 12 01:30:37.221946 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 214/415] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:36 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1707 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:37.390501 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-24423111-09d2-4a9c-941f-914798c0d017 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:37.391078 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-24423111-09d2-4a9c-941f-914798c0d017 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: c84abe93-9e47-4be1-b119-e0235ac5b527] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:37.397377 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-24423111-09d2-4a9c-941f-914798c0d017 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:37.397858 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-24423111-09d2-4a9c-941f-914798c0d017 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:37.398268 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-24423111-09d2-4a9c-941f-914798c0d017 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:37.398981 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-24423111-09d2-4a9c-941f-914798c0d017 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:37.399432 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-24423111-09d2-4a9c-941f-914798c0d017 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:37.399883 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-24423111-09d2-4a9c-941f-914798c0d017 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:37.413467 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.wsgi [None req-24423111-09d2-4a9c-941f-914798c0d017 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] HTTP exception thrown: Instance c84abe93-9e47-4be1-b119-e0235ac5b527 could not be found. Aug 12 01:30:37.415150 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-24423111-09d2-4a9c-941f-914798c0d017 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Request method failure captured: Aug 12 01:30:37.415150 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: request: GET /compute/v2.1/servers/c84abe93-9e47-4be1-b119-e0235ac5b527 HTTP/1.1 Aug 12 01:30:37.415150 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept: application/json Aug 12 01:30:37.415150 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept-Encoding: identity Aug 12 01:30:37.415150 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Connection: close Aug 12 01:30:37.415150 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Length: 0 Aug 12 01:30:37.415150 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Type: application/json Aug 12 01:30:37.415150 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Host: 10.222.0.20 Aug 12 01:30:37.415150 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Openstack-System-Scope: None Aug 12 01:30:37.415150 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: User-Agent: python-urllib3/1.26.11 Aug 12 01:30:37.415150 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Auth-Token: gAAAAABi9a0iOi0g6SJF3zz9Lk4dwOSX9ERVkzpyo0liYLKETjH2kjyqGhxBlp7pK4Ad6rzlakMfqOWSM0UWbQzFMxZBwIVumIgZPD2yYBJ4TthAF3Umx85AP0f3eIxCn2V4iiz_Wq1utRMdKX7SoZcIKGrsM3uOFkshiAdxYInvnujXg53uMLc Aug 12 01:30:37.415150 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Id: None Aug 12 01:30:37.415150 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Name: None Aug 12 01:30:37.415150 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Identity-Status: Confirmed Aug 12 01:30:37.415150 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Is-Admin-Project: True Aug 12 01:30:37.415150 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Id: default Aug 12 01:30:37.415150 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Name: Default Aug 12 01:30:37.415150 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Id: 2aa3549819204b219cbf52a1f9e004e9 Aug 12 01:30:37.415150 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Name: tempest-VolumesActionsTest-986704748 Aug 12 01:30:37.415150 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Role: member,reader Aug 12 01:30:37.415150 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Roles: member,reader Aug 12 01:30:37.416721 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2aa3549819204b219cbf52a1f9e004e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2aa3549819204b219cbf52a1f9e004e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2aa3549819204b219cbf52a1f9e004e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2aa3549819204b219cbf52a1f9e004e9"}]}] Aug 12 01:30:37.416721 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant: tempest-VolumesActionsTest-986704748 Aug 12 01:30:37.416721 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Id: 2aa3549819204b219cbf52a1f9e004e9 Aug 12 01:30:37.416721 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Name: tempest-VolumesActionsTest-986704748 Aug 12 01:30:37.416721 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User: tempest-VolumesActionsTest-986704748-project Aug 12 01:30:37.416721 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Id: default Aug 12 01:30:37.416721 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Name: Default Aug 12 01:30:37.416721 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Id: 1242495b42384050a1da78e89821dc77 Aug 12 01:30:37.416721 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Name: tempest-VolumesActionsTest-986704748-project Aug 12 01:30:37.416721 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: method: > Aug 12 01:30:37.416721 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: exception: Instance c84abe93-9e47-4be1-b119-e0235ac5b527 could not be found. Aug 12 01:30:37.416721 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: action_args: {'id': 'c84abe93-9e47-4be1-b119-e0235ac5b527'} Aug 12 01:30:37.417531 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:30:37.417531 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:30:37.417531 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:30:37.417531 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:30:37.417531 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:30:37.417531 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:30:37.417531 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:30:37.417531 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:30:37.417531 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:30:37.417531 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:30:37.417531 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c84abe93-9e47-4be1-b119-e0235ac5b527 could not be found. Aug 12 01:30:37.417531 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:30:37.417531 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:30:37.417531 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:30:37.417531 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:30:37.417531 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:30:37.417531 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:30:37.417531 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:30:37.417531 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:30:37.417531 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:30:37.418807 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:30:37.418807 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 01:30:37.418807 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 01:30:37.418807 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:30:37.418807 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:30:37.418807 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:30:37.418807 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:30:37.418807 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c84abe93-9e47-4be1-b119-e0235ac5b527 could not be found. Aug 12 01:30:37.418807 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:30:37.418807 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:30:37.418807 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:30:37.418807 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:30:37.418807 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:30:37.418807 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:30:37.418807 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:30:37.418807 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:30:37.418807 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c84abe93-9e47-4be1-b119-e0235ac5b527 could not be found. Aug 12 01:30:37.418807 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:30:37.420785 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-24423111-09d2-4a9c-941f-914798c0d017 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Returning 404 to user: Instance c84abe93-9e47-4be1-b119-e0235ac5b527 could not be found. {{(pid=120785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:30:37.420785 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-24423111-09d2-4a9c-941f-914798c0d017 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/c84abe93-9e47-4be1-b119-e0235ac5b527" status: 404 len: 111 microversion: 2.1 time: 0.030063 Aug 12 01:30:37.420785 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 202/416] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:37 2022] GET /compute/v2.1/servers/c84abe93-9e47-4be1-b119-e0235ac5b527 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:30:37.470340 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-da5f968a-a623-414d-b296-1a714b6500d5 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1077146947", "imageRef": "0d77ae04-91a5-4e2b-8817-72986618c549", "flavorRef": "452", "networks": [{"uuid": "4b8c5935-38ca-4347-9afe-7a0258f6b445"}]}} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:30:37.525208 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.network.neutron [None req-da5f968a-a623-414d-b296-1a714b6500d5 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] validate_networks() for [('4b8c5935-38ca-4347-9afe-7a0258f6b445', None, None, None, None, None)] {{(pid=120786) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 01:30:37.537709 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-41f7807c-8b6d-451b-ac55-980012f54142 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:37.538714 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-41f7807c-8b6d-451b-ac55-980012f54142 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:37.549528 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-41f7807c-8b6d-451b-ac55-980012f54142 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:37.550833 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-41f7807c-8b6d-451b-ac55-980012f54142 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:37.551942 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-41f7807c-8b6d-451b-ac55-980012f54142 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:37.552793 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-41f7807c-8b6d-451b-ac55-980012f54142 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:37.553826 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-41f7807c-8b6d-451b-ac55-980012f54142 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:37.554400 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-41f7807c-8b6d-451b-ac55-980012f54142 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:37.737182 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-41f7807c-8b6d-451b-ac55-980012f54142 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:37.745962 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-41f7807c-8b6d-451b-ac55-980012f54142 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:37.747516 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-41f7807c-8b6d-451b-ac55-980012f54142 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:37.748721 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-41f7807c-8b6d-451b-ac55-980012f54142 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1666 microversion: 2.20 time: 0.218370 Aug 12 01:30:37.753330 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 203/417] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:37 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1666 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 01:30:37.771148 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-5bacc71b-4dbb-4fb7-a83d-fda995786c74 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0dd28f4b-8e05-40c8-8503-5ce1960bd019"}} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:30:37.773718 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-5bacc71b-4dbb-4fb7-a83d-fda995786c74 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:37.782268 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5bacc71b-4dbb-4fb7-a83d-fda995786c74 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:37.783139 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5bacc71b-4dbb-4fb7-a83d-fda995786c74 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:37.783934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5bacc71b-4dbb-4fb7-a83d-fda995786c74 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:37.784651 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5bacc71b-4dbb-4fb7-a83d-fda995786c74 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:37.785103 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5bacc71b-4dbb-4fb7-a83d-fda995786c74 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:37.785525 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5bacc71b-4dbb-4fb7-a83d-fda995786c74 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:38.067117 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-da5f968a-a623-414d-b296-1a714b6500d5 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Flavor limits 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 01:30:38.067783 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-da5f968a-a623-414d-b296-1a714b6500d5 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Image limits 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 01:30:38.068532 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-da5f968a-a623-414d-b296-1a714b6500d5 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Flavor pref 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 01:30:38.069170 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-da5f968a-a623-414d-b296-1a714b6500d5 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Image pref 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 01:30:38.069744 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-da5f968a-a623-414d-b296-1a714b6500d5 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 01:30:38.083753 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-da5f968a-a623-414d-b296-1a714b6500d5 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:38.084947 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-da5f968a-a623-414d-b296-1a714b6500d5 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:38.085722 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-da5f968a-a623-414d-b296-1a714b6500d5 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:38.086729 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-da5f968a-a623-414d-b296-1a714b6500d5 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:38.087704 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-da5f968a-a623-414d-b296-1a714b6500d5 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:38.088307 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-da5f968a-a623-414d-b296-1a714b6500d5 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:38.117063 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.quota [None req-da5f968a-a623-414d-b296-1a714b6500d5 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Getting quotas for project 2aa3549819204b219cbf52a1f9e004e9. Resources: {'cores', 'ram', 'instances'} {{(pid=120786) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 01:30:38.122345 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.quota [None req-da5f968a-a623-414d-b296-1a714b6500d5 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Getting quotas for user 1242495b42384050a1da78e89821dc77 and project 2aa3549819204b219cbf52a1f9e004e9. Resources: {'cores', 'ram', 'instances'} {{(pid=120786) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 01:30:38.136088 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-da5f968a-a623-414d-b296-1a714b6500d5 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Going to run 1 instances... {{(pid=120786) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 01:30:38.138377 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-da5f968a-a623-414d-b296-1a714b6500d5 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: ecabacb5-7e74-412d-990b-52e1181cba09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d77ae04-91a5-4e2b-8817-72986618c549',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120786) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 01:30:38.155195 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-5bacc71b-4dbb-4fb7-a83d-fda995786c74 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "POST /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.388286 Aug 12 01:30:38.155850 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 204/418] 10.222.0.20 () {62 vars in 1364 bytes} [Fri Aug 12 01:30:37 2022] POST /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8/os-volume_attachments => generated 188 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 12 01:30:38.163404 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-4102ab11-85d0-4cdd-acf6-4fd759968fd1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:38.163874 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-4102ab11-85d0-4cdd-acf6-4fd759968fd1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:38.180828 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4102ab11-85d0-4cdd-acf6-4fd759968fd1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:38.181585 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4102ab11-85d0-4cdd-acf6-4fd759968fd1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:38.182227 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4102ab11-85d0-4cdd-acf6-4fd759968fd1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:38.183151 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4102ab11-85d0-4cdd-acf6-4fd759968fd1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:38.183786 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4102ab11-85d0-4cdd-acf6-4fd759968fd1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:38.184369 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4102ab11-85d0-4cdd-acf6-4fd759968fd1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:38.230624 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-da5f968a-a623-414d-b296-1a714b6500d5 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.762886 Aug 12 01:30:38.231715 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 215/419] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 01:30:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 01:30:38.246664 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-3a787a8d-b622-4b98-8707-4919368a70ed tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:38.251993 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-3a787a8d-b622-4b98-8707-4919368a70ed tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:38.274657 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3a787a8d-b622-4b98-8707-4919368a70ed tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:38.278945 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3a787a8d-b622-4b98-8707-4919368a70ed tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:38.279445 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3a787a8d-b622-4b98-8707-4919368a70ed tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:38.282709 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3a787a8d-b622-4b98-8707-4919368a70ed tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:38.283176 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3a787a8d-b622-4b98-8707-4919368a70ed tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:38.283822 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3a787a8d-b622-4b98-8707-4919368a70ed tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:38.735133 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-4102ab11-85d0-4cdd-acf6-4fd759968fd1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:38.744797 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-4102ab11-85d0-4cdd-acf6-4fd759968fd1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1370 microversion: 2.1 time: 0.587627 Aug 12 01:30:38.758786 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 205/420] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:38 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1370 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:38.764896 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-44a84f54-c41d-436e-8d73-cd69968d0e88 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:38.765613 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-44a84f54-c41d-436e-8d73-cd69968d0e88 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: ecabacb5-7e74-412d-990b-52e1181cba09] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:38.765945 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-3a787a8d-b622-4b98-8707-4919368a70ed tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:38.772006 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-44a84f54-c41d-436e-8d73-cd69968d0e88 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:38.772577 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-44a84f54-c41d-436e-8d73-cd69968d0e88 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:38.773249 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-44a84f54-c41d-436e-8d73-cd69968d0e88 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:38.773941 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-3a787a8d-b622-4b98-8707-4919368a70ed tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1707 microversion: 2.1 time: 0.535133 Aug 12 01:30:38.774259 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-44a84f54-c41d-436e-8d73-cd69968d0e88 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:38.774504 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 216/421] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:38 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1707 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:38.787648 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-44a84f54-c41d-436e-8d73-cd69968d0e88 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:38.787648 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-44a84f54-c41d-436e-8d73-cd69968d0e88 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:38.792910 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-3615f2f4-0d24-4b16-a4c0-e688cb93df82 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:30:38.793698 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-3615f2f4-0d24-4b16-a4c0-e688cb93df82 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:38.799647 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3615f2f4-0d24-4b16-a4c0-e688cb93df82 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:38.800292 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3615f2f4-0d24-4b16-a4c0-e688cb93df82 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:38.800715 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3615f2f4-0d24-4b16-a4c0-e688cb93df82 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:38.801401 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3615f2f4-0d24-4b16-a4c0-e688cb93df82 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:38.801858 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3615f2f4-0d24-4b16-a4c0-e688cb93df82 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:38.802276 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3615f2f4-0d24-4b16-a4c0-e688cb93df82 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:38.852810 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-44a84f54-c41d-436e-8d73-cd69968d0e88 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:38.853068 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-3615f2f4-0d24-4b16-a4c0-e688cb93df82 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120786) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 12 01:30:38.861122 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-44a84f54-c41d-436e-8d73-cd69968d0e88 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09" status: 200 len: 1218 microversion: 2.1 time: 0.100988 Aug 12 01:30:38.861693 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 206/422] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:38 2022] GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09 => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:38.922531 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-3615f2f4-0d24-4b16-a4c0-e688cb93df82 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "POST /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8/action" status: 202 len: 0 microversion: 2.20 time: 0.133415 Aug 12 01:30:38.923442 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 217/423] 10.222.0.20 () {62 vars in 1319 bytes} [Fri Aug 12 01:30:38 2022] POST /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 12 01:30:38.957679 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-41fc07a4-cb1d-4d42-9dc7-cb1ecfa6a70a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:38.960512 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-41fc07a4-cb1d-4d42-9dc7-cb1ecfa6a70a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:38.978122 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-41fc07a4-cb1d-4d42-9dc7-cb1ecfa6a70a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:38.982760 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-41fc07a4-cb1d-4d42-9dc7-cb1ecfa6a70a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:38.985311 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-41fc07a4-cb1d-4d42-9dc7-cb1ecfa6a70a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:38.986385 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-41fc07a4-cb1d-4d42-9dc7-cb1ecfa6a70a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:38.989676 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-41fc07a4-cb1d-4d42-9dc7-cb1ecfa6a70a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:38.990305 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-41fc07a4-cb1d-4d42-9dc7-cb1ecfa6a70a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:39.145879 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-41fc07a4-cb1d-4d42-9dc7-cb1ecfa6a70a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:39.154640 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-41fc07a4-cb1d-4d42-9dc7-cb1ecfa6a70a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:39.156163 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-41fc07a4-cb1d-4d42-9dc7-cb1ecfa6a70a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:39.157463 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-41fc07a4-cb1d-4d42-9dc7-cb1ecfa6a70a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1752 microversion: 2.20 time: 0.218282 Aug 12 01:30:39.160985 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 207/424] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:38 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1752 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:30:39.766958 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-57a9771f-6203-418d-93bf-f153905c2965 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:39.768259 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-57a9771f-6203-418d-93bf-f153905c2965 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:39.774536 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-57a9771f-6203-418d-93bf-f153905c2965 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:39.775276 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-57a9771f-6203-418d-93bf-f153905c2965 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:39.776000 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-57a9771f-6203-418d-93bf-f153905c2965 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:39.776990 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-57a9771f-6203-418d-93bf-f153905c2965 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:39.777588 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-57a9771f-6203-418d-93bf-f153905c2965 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:39.778278 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-57a9771f-6203-418d-93bf-f153905c2965 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:39.794374 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-f0e14d6c-8f24-4244-b117-d4ca03134b3a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:39.795680 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-f0e14d6c-8f24-4244-b117-d4ca03134b3a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:39.808631 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f0e14d6c-8f24-4244-b117-d4ca03134b3a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:39.809154 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f0e14d6c-8f24-4244-b117-d4ca03134b3a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:39.809574 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f0e14d6c-8f24-4244-b117-d4ca03134b3a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:39.810269 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f0e14d6c-8f24-4244-b117-d4ca03134b3a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:39.810720 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f0e14d6c-8f24-4244-b117-d4ca03134b3a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:39.815251 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f0e14d6c-8f24-4244-b117-d4ca03134b3a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:40.025819 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-57a9771f-6203-418d-93bf-f153905c2965 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:40.053567 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-57a9771f-6203-418d-93bf-f153905c2965 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1563 microversion: 2.1 time: 0.292125 Aug 12 01:30:40.059876 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 218/425] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:39 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1563 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:40.065547 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-0574c875-b84b-404c-92c6-67d70e254e8b tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:40.075581 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-0574c875-b84b-404c-92c6-67d70e254e8b tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: ecabacb5-7e74-412d-990b-52e1181cba09] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:40.084925 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0574c875-b84b-404c-92c6-67d70e254e8b tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:40.085624 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0574c875-b84b-404c-92c6-67d70e254e8b tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:40.086405 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0574c875-b84b-404c-92c6-67d70e254e8b tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:40.087803 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0574c875-b84b-404c-92c6-67d70e254e8b tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:40.088595 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0574c875-b84b-404c-92c6-67d70e254e8b tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:40.089230 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0574c875-b84b-404c-92c6-67d70e254e8b tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:40.099293 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-f0e14d6c-8f24-4244-b117-d4ca03134b3a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:40.110966 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-f0e14d6c-8f24-4244-b117-d4ca03134b3a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1707 microversion: 2.1 time: 0.320591 Aug 12 01:30:40.112097 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 208/426] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:39 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1707 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:30:40.117793 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-729f472d-a681-46bc-aa5e-d6e983ea77d2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:40.118554 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-729f472d-a681-46bc-aa5e-d6e983ea77d2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:40.125186 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-729f472d-a681-46bc-aa5e-d6e983ea77d2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:40.125859 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-729f472d-a681-46bc-aa5e-d6e983ea77d2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:40.126680 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-729f472d-a681-46bc-aa5e-d6e983ea77d2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:40.127790 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-729f472d-a681-46bc-aa5e-d6e983ea77d2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:40.128459 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-729f472d-a681-46bc-aa5e-d6e983ea77d2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:40.129108 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-729f472d-a681-46bc-aa5e-d6e983ea77d2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:40.173496 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-0574c875-b84b-404c-92c6-67d70e254e8b tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:40.181412 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-0574c875-b84b-404c-92c6-67d70e254e8b tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09" status: 200 len: 1274 microversion: 2.1 time: 0.120283 Aug 12 01:30:40.181996 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 219/427] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:40 2022] GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09 => generated 1274 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:40.186451 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-60f58e6d-5db9-4060-9205-87142aea3f18 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:40.187828 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-60f58e6d-5db9-4060-9205-87142aea3f18 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:40.193754 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-60f58e6d-5db9-4060-9205-87142aea3f18 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:40.194226 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-60f58e6d-5db9-4060-9205-87142aea3f18 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:40.194651 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-60f58e6d-5db9-4060-9205-87142aea3f18 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:40.195333 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-60f58e6d-5db9-4060-9205-87142aea3f18 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:40.195867 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-60f58e6d-5db9-4060-9205-87142aea3f18 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:40.196282 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-60f58e6d-5db9-4060-9205-87142aea3f18 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:40.225075 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-729f472d-a681-46bc-aa5e-d6e983ea77d2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111806 Aug 12 01:30:40.225687 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 209/428] 10.222.0.20 () {58 vars in 1275 bytes} [Fri Aug 12 01:30:40 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:30:40.327478 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-60f58e6d-5db9-4060-9205-87142aea3f18 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:40.336234 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-60f58e6d-5db9-4060-9205-87142aea3f18 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:40.337940 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-60f58e6d-5db9-4060-9205-87142aea3f18 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:40.339183 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-60f58e6d-5db9-4060-9205-87142aea3f18 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1752 microversion: 2.20 time: 0.156246 Aug 12 01:30:40.339902 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 220/429] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:40 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:30:41.133338 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-84821216-3838-4300-a5f2-3dbc9f7282bc tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:41.133993 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-84821216-3838-4300-a5f2-3dbc9f7282bc tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:41.141332 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-84821216-3838-4300-a5f2-3dbc9f7282bc tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:41.141978 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-84821216-3838-4300-a5f2-3dbc9f7282bc tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:41.142376 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-84821216-3838-4300-a5f2-3dbc9f7282bc tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:41.143138 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-84821216-3838-4300-a5f2-3dbc9f7282bc tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:41.143638 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-84821216-3838-4300-a5f2-3dbc9f7282bc tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:41.144092 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-84821216-3838-4300-a5f2-3dbc9f7282bc tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:41.206235 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-4ab901b2-a807-4c68-ad48-f8fd93b620cf tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:41.207392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-4ab901b2-a807-4c68-ad48-f8fd93b620cf tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: ecabacb5-7e74-412d-990b-52e1181cba09] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:41.210954 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:41.214930 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4ab901b2-a807-4c68-ad48-f8fd93b620cf tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:41.215690 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4ab901b2-a807-4c68-ad48-f8fd93b620cf tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:41.216274 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4ab901b2-a807-4c68-ad48-f8fd93b620cf tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:41.217157 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4ab901b2-a807-4c68-ad48-f8fd93b620cf tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:41.217900 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4ab901b2-a807-4c68-ad48-f8fd93b620cf tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:41.218471 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4ab901b2-a807-4c68-ad48-f8fd93b620cf tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:41.519346 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-84821216-3838-4300-a5f2-3dbc9f7282bc tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:41.536857 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-84821216-3838-4300-a5f2-3dbc9f7282bc tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1711 microversion: 2.1 time: 0.407681 Aug 12 01:30:41.538131 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 210/430] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:41 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1711 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:41.539714 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-4ab901b2-a807-4c68-ad48-f8fd93b620cf tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:41.553468 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-5fe90c86-269c-4f3e-aa14-bf98cfc115ba tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:41.554156 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-4ab901b2-a807-4c68-ad48-f8fd93b620cf tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09" status: 200 len: 1314 microversion: 2.1 time: 0.355295 Aug 12 01:30:41.555146 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 221/431] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:41 2022] GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09 => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:30:41.557068 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-5fe90c86-269c-4f3e-aa14-bf98cfc115ba tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:41.562295 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-70f8d3d5-9d9f-454b-9d44-c14c4024da83 req-0b1ae5f5-aee1-434f-9559-8c181347e942 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a", "tag": "dc2ec8af-df9c-48b9-af2f-f3d087bf0f93"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:30:41.573833 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-70f8d3d5-9d9f-454b-9d44-c14c4024da83 req-0b1ae5f5-aee1-434f-9559-8c181347e942 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:41.574539 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-70f8d3d5-9d9f-454b-9d44-c14c4024da83 req-0b1ae5f5-aee1-434f-9559-8c181347e942 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:41.575128 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-70f8d3d5-9d9f-454b-9d44-c14c4024da83 req-0b1ae5f5-aee1-434f-9559-8c181347e942 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:41.579218 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5fe90c86-269c-4f3e-aa14-bf98cfc115ba tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:41.579737 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5fe90c86-269c-4f3e-aa14-bf98cfc115ba tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:41.582152 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5fe90c86-269c-4f3e-aa14-bf98cfc115ba tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:41.582913 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5fe90c86-269c-4f3e-aa14-bf98cfc115ba tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:41.583373 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5fe90c86-269c-4f3e-aa14-bf98cfc115ba tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:41.585261 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5fe90c86-269c-4f3e-aa14-bf98cfc115ba tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:41.590351 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-70f8d3d5-9d9f-454b-9d44-c14c4024da83 req-0b1ae5f5-aee1-434f-9559-8c181347e942 service nova] Creating event network-changed:dc2ec8af-df9c-48b9-af2f-f3d087bf0f93 for instance f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a on hv-cinder-78481 Aug 12 01:30:41.597019 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-70f8d3d5-9d9f-454b-9d44-c14c4024da83 req-0b1ae5f5-aee1-434f-9559-8c181347e942 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040108 Aug 12 01:30:41.597778 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 222/432] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:30:41.885506 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-5fe90c86-269c-4f3e-aa14-bf98cfc115ba tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:41.892831 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:41.905565 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-5fe90c86-269c-4f3e-aa14-bf98cfc115ba tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:41.907356 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-5fe90c86-269c-4f3e-aa14-bf98cfc115ba tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:41.909391 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-5fe90c86-269c-4f3e-aa14-bf98cfc115ba tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1754 microversion: 2.20 time: 0.369862 Aug 12 01:30:41.911092 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 211/433] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:41 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1754 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:30:42.237192 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-7892ee6d-d597-42a2-99aa-450cf813119b req-ce9037c1-3940-45a9-9b50-4934a5d7d206 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecabacb5-7e74-412d-990b-52e1181cba09", "tag": "69a228ea-3a58-4a03-aed1-43d09cbcc476"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:30:42.257471 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-7892ee6d-d597-42a2-99aa-450cf813119b req-ce9037c1-3940-45a9-9b50-4934a5d7d206 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:42.258194 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-7892ee6d-d597-42a2-99aa-450cf813119b req-ce9037c1-3940-45a9-9b50-4934a5d7d206 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:42.259136 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-7892ee6d-d597-42a2-99aa-450cf813119b req-ce9037c1-3940-45a9-9b50-4934a5d7d206 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:42.292448 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-7892ee6d-d597-42a2-99aa-450cf813119b req-ce9037c1-3940-45a9-9b50-4934a5d7d206 service nova] Creating event network-changed:69a228ea-3a58-4a03-aed1-43d09cbcc476 for instance ecabacb5-7e74-412d-990b-52e1181cba09 on hv-cinder-78481 Aug 12 01:30:42.297433 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-7892ee6d-d597-42a2-99aa-450cf813119b req-ce9037c1-3940-45a9-9b50-4934a5d7d206 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067789 Aug 12 01:30:42.298579 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 223/434] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:30:42.577682 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-961bd6b6-f8ae-4788-ab95-2d004724a57d tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:42.578693 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-961bd6b6-f8ae-4788-ab95-2d004724a57d tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: ecabacb5-7e74-412d-990b-52e1181cba09] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:42.585335 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-961bd6b6-f8ae-4788-ab95-2d004724a57d tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:42.586048 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-961bd6b6-f8ae-4788-ab95-2d004724a57d tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:42.586622 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-961bd6b6-f8ae-4788-ab95-2d004724a57d tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:42.587499 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-961bd6b6-f8ae-4788-ab95-2d004724a57d tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:42.588001 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-961bd6b6-f8ae-4788-ab95-2d004724a57d tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:42.588359 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-961bd6b6-f8ae-4788-ab95-2d004724a57d tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:42.800713 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-961bd6b6-f8ae-4788-ab95-2d004724a57d tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:42.811322 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-961bd6b6-f8ae-4788-ab95-2d004724a57d tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09" status: 200 len: 1314 microversion: 2.1 time: 0.237787 Aug 12 01:30:42.812226 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 212/435] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:42 2022] GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:42.934206 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-8cbf496e-c377-4aad-b460-35d0cf28d811 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:42.934864 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-8cbf496e-c377-4aad-b460-35d0cf28d811 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:42.941742 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8cbf496e-c377-4aad-b460-35d0cf28d811 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:42.942230 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8cbf496e-c377-4aad-b460-35d0cf28d811 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:42.942658 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8cbf496e-c377-4aad-b460-35d0cf28d811 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:42.943394 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8cbf496e-c377-4aad-b460-35d0cf28d811 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:42.943896 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8cbf496e-c377-4aad-b460-35d0cf28d811 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:42.944313 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8cbf496e-c377-4aad-b460-35d0cf28d811 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:43.080792 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-8cbf496e-c377-4aad-b460-35d0cf28d811 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:43.089497 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-8cbf496e-c377-4aad-b460-35d0cf28d811 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:43.091001 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-8cbf496e-c377-4aad-b460-35d0cf28d811 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:43.092223 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-8cbf496e-c377-4aad-b460-35d0cf28d811 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1810 microversion: 2.20 time: 0.162647 Aug 12 01:30:43.092793 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 224/436] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:42 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:30:43.833544 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-7a208086-9547-4221-ae38-0f7e91f1f3e2 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:43.834190 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-7a208086-9547-4221-ae38-0f7e91f1f3e2 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: ecabacb5-7e74-412d-990b-52e1181cba09] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:43.842091 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7a208086-9547-4221-ae38-0f7e91f1f3e2 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:43.842622 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7a208086-9547-4221-ae38-0f7e91f1f3e2 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:43.843097 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7a208086-9547-4221-ae38-0f7e91f1f3e2 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:43.843896 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7a208086-9547-4221-ae38-0f7e91f1f3e2 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:43.844392 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7a208086-9547-4221-ae38-0f7e91f1f3e2 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:43.844946 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7a208086-9547-4221-ae38-0f7e91f1f3e2 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:43.987964 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-7a208086-9547-4221-ae38-0f7e91f1f3e2 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:43.995497 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-7a208086-9547-4221-ae38-0f7e91f1f3e2 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09" status: 200 len: 1314 microversion: 2.1 time: 0.166551 Aug 12 01:30:43.996251 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 213/437] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:43 2022] GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:44.119495 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-02040c03-f021-48ab-b6a9-3f1fbd8bf57f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:44.120439 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-02040c03-f021-48ab-b6a9-3f1fbd8bf57f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:44.129589 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-02040c03-f021-48ab-b6a9-3f1fbd8bf57f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:44.130074 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-02040c03-f021-48ab-b6a9-3f1fbd8bf57f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:44.130476 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-02040c03-f021-48ab-b6a9-3f1fbd8bf57f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:44.131404 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-02040c03-f021-48ab-b6a9-3f1fbd8bf57f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:44.132025 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-02040c03-f021-48ab-b6a9-3f1fbd8bf57f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:44.132441 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-02040c03-f021-48ab-b6a9-3f1fbd8bf57f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:44.359044 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-02040c03-f021-48ab-b6a9-3f1fbd8bf57f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:44.372195 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-02040c03-f021-48ab-b6a9-3f1fbd8bf57f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:44.374460 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-02040c03-f021-48ab-b6a9-3f1fbd8bf57f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:44.376110 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-02040c03-f021-48ab-b6a9-3f1fbd8bf57f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1810 microversion: 2.20 time: 0.263009 Aug 12 01:30:44.376343 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 225/438] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:44 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1810 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:30:45.015869 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-70912724-e559-4243-85f0-11752618352c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:45.016699 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-70912724-e559-4243-85f0-11752618352c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: ecabacb5-7e74-412d-990b-52e1181cba09] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:45.019251 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_api:SELECT=100 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:45.026010 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-70912724-e559-4243-85f0-11752618352c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:45.026723 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-70912724-e559-4243-85f0-11752618352c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:45.027303 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-70912724-e559-4243-85f0-11752618352c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:45.028199 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-70912724-e559-4243-85f0-11752618352c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:45.028797 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-70912724-e559-4243-85f0-11752618352c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:45.029365 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-70912724-e559-4243-85f0-11752618352c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:45.167704 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-70912724-e559-4243-85f0-11752618352c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:45.175356 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-70912724-e559-4243-85f0-11752618352c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09" status: 200 len: 1314 microversion: 2.1 time: 0.163373 Aug 12 01:30:45.175991 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 214/439] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:45 2022] GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:45.399243 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-07d36d72-34cc-4605-9750-d851fad445a2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:45.399897 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-07d36d72-34cc-4605-9750-d851fad445a2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:45.407086 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-07d36d72-34cc-4605-9750-d851fad445a2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:45.407592 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-07d36d72-34cc-4605-9750-d851fad445a2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:45.408033 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-07d36d72-34cc-4605-9750-d851fad445a2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:45.408738 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-07d36d72-34cc-4605-9750-d851fad445a2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:45.409187 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-07d36d72-34cc-4605-9750-d851fad445a2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:45.409610 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-07d36d72-34cc-4605-9750-d851fad445a2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:45.555825 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-07d36d72-34cc-4605-9750-d851fad445a2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:45.564195 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-07d36d72-34cc-4605-9750-d851fad445a2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:45.565708 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-07d36d72-34cc-4605-9750-d851fad445a2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:45.566915 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-07d36d72-34cc-4605-9750-d851fad445a2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1810 microversion: 2.20 time: 0.172329 Aug 12 01:30:45.567484 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 226/440] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:45 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:30:46.201471 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-10246fc5-6594-4daf-a906-2ea90fbf2d47 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:46.202075 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-10246fc5-6594-4daf-a906-2ea90fbf2d47 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: ecabacb5-7e74-412d-990b-52e1181cba09] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:46.215285 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-10246fc5-6594-4daf-a906-2ea90fbf2d47 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:46.216093 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-10246fc5-6594-4daf-a906-2ea90fbf2d47 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:46.216823 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-10246fc5-6594-4daf-a906-2ea90fbf2d47 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:46.217704 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-10246fc5-6594-4daf-a906-2ea90fbf2d47 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:46.218307 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-10246fc5-6594-4daf-a906-2ea90fbf2d47 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:46.218878 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-10246fc5-6594-4daf-a906-2ea90fbf2d47 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:46.401778 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-10246fc5-6594-4daf-a906-2ea90fbf2d47 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:46.409701 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-10246fc5-6594-4daf-a906-2ea90fbf2d47 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09" status: 200 len: 1314 microversion: 2.1 time: 0.212179 Aug 12 01:30:46.410466 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 215/441] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:46 2022] GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:46.599870 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-5e3e6c82-c461-4b5c-b585-e5897eecc373 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:46.600943 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-5e3e6c82-c461-4b5c-b585-e5897eecc373 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:46.608334 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5e3e6c82-c461-4b5c-b585-e5897eecc373 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:46.608817 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5e3e6c82-c461-4b5c-b585-e5897eecc373 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:46.609243 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5e3e6c82-c461-4b5c-b585-e5897eecc373 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:46.609976 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5e3e6c82-c461-4b5c-b585-e5897eecc373 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:46.610572 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5e3e6c82-c461-4b5c-b585-e5897eecc373 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:46.611058 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5e3e6c82-c461-4b5c-b585-e5897eecc373 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:46.767676 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-5e3e6c82-c461-4b5c-b585-e5897eecc373 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:46.776249 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-5e3e6c82-c461-4b5c-b585-e5897eecc373 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:46.777736 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-5e3e6c82-c461-4b5c-b585-e5897eecc373 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:46.778972 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-5e3e6c82-c461-4b5c-b585-e5897eecc373 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1810 microversion: 2.20 time: 0.184426 Aug 12 01:30:46.793998 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 227/442] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:46 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1810 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:30:47.432714 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-d982b140-4590-4eea-9f29-a1178f737050 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:47.434250 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-d982b140-4590-4eea-9f29-a1178f737050 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: ecabacb5-7e74-412d-990b-52e1181cba09] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:47.443852 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d982b140-4590-4eea-9f29-a1178f737050 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:47.443852 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d982b140-4590-4eea-9f29-a1178f737050 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:47.444156 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d982b140-4590-4eea-9f29-a1178f737050 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:47.445069 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d982b140-4590-4eea-9f29-a1178f737050 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:47.445417 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d982b140-4590-4eea-9f29-a1178f737050 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:47.445917 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d982b140-4590-4eea-9f29-a1178f737050 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:47.597830 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-d982b140-4590-4eea-9f29-a1178f737050 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:47.605602 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-d982b140-4590-4eea-9f29-a1178f737050 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09" status: 200 len: 1314 microversion: 2.1 time: 0.178893 Aug 12 01:30:47.618689 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 216/443] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:47 2022] GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:47.814483 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-db33e76b-9464-4ac1-8253-3baf68fb2fc4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:47.818493 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-db33e76b-9464-4ac1-8253-3baf68fb2fc4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:47.837500 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-db33e76b-9464-4ac1-8253-3baf68fb2fc4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:47.838623 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-db33e76b-9464-4ac1-8253-3baf68fb2fc4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:47.839119 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-db33e76b-9464-4ac1-8253-3baf68fb2fc4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:47.841177 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-db33e76b-9464-4ac1-8253-3baf68fb2fc4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:47.841616 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-db33e76b-9464-4ac1-8253-3baf68fb2fc4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:47.842024 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-db33e76b-9464-4ac1-8253-3baf68fb2fc4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:47.978775 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-db33e76b-9464-4ac1-8253-3baf68fb2fc4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:47.987670 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-db33e76b-9464-4ac1-8253-3baf68fb2fc4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:47.989162 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-db33e76b-9464-4ac1-8253-3baf68fb2fc4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:47.990324 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-db33e76b-9464-4ac1-8253-3baf68fb2fc4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1810 microversion: 2.20 time: 0.187154 Aug 12 01:30:47.990949 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 228/444] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:47 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1810 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:30:48.286576 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-cfdaee47-8cc7-457a-ba55-8f651a17dbaf req-6572ee4a-e0ec-4097-9dbe-f481adbc5be8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecabacb5-7e74-412d-990b-52e1181cba09", "name": "network-vif-plugged", "status": "completed", "tag": "69a228ea-3a58-4a03-aed1-43d09cbcc476"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:30:48.311941 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-cfdaee47-8cc7-457a-ba55-8f651a17dbaf req-6572ee4a-e0ec-4097-9dbe-f481adbc5be8 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:48.312764 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-cfdaee47-8cc7-457a-ba55-8f651a17dbaf req-6572ee4a-e0ec-4097-9dbe-f481adbc5be8 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:48.313313 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-cfdaee47-8cc7-457a-ba55-8f651a17dbaf req-6572ee4a-e0ec-4097-9dbe-f481adbc5be8 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:48.331878 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-cfdaee47-8cc7-457a-ba55-8f651a17dbaf req-6572ee4a-e0ec-4097-9dbe-f481adbc5be8 service nova] Creating event network-vif-plugged:69a228ea-3a58-4a03-aed1-43d09cbcc476 for instance ecabacb5-7e74-412d-990b-52e1181cba09 on hv-cinder-78481 Aug 12 01:30:48.355455 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-cfdaee47-8cc7-457a-ba55-8f651a17dbaf req-6572ee4a-e0ec-4097-9dbe-f481adbc5be8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069686 Aug 12 01:30:48.355455 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 217/445] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 01:30:48.626765 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-56f0dc7c-4f2f-4c80-bf37-7db326d52cbb tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:48.627288 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-56f0dc7c-4f2f-4c80-bf37-7db326d52cbb tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: ecabacb5-7e74-412d-990b-52e1181cba09] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:48.629451 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell0:SELECT=2 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:48.630514 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell0:SELECT=6 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:48.637608 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-56f0dc7c-4f2f-4c80-bf37-7db326d52cbb tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:48.638178 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-56f0dc7c-4f2f-4c80-bf37-7db326d52cbb tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:48.638674 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-56f0dc7c-4f2f-4c80-bf37-7db326d52cbb tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:48.639419 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-56f0dc7c-4f2f-4c80-bf37-7db326d52cbb tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:48.640011 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-56f0dc7c-4f2f-4c80-bf37-7db326d52cbb tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:48.640670 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-56f0dc7c-4f2f-4c80-bf37-7db326d52cbb tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:48.789628 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-56f0dc7c-4f2f-4c80-bf37-7db326d52cbb tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:48.797962 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-56f0dc7c-4f2f-4c80-bf37-7db326d52cbb tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09" status: 200 len: 1314 microversion: 2.1 time: 0.175354 Aug 12 01:30:48.798971 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 229/446] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:48 2022] GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:49.013951 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-2654cf30-0094-4fbd-adbf-67a4c914a250 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:49.014692 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-2654cf30-0094-4fbd-adbf-67a4c914a250 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:49.021353 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2654cf30-0094-4fbd-adbf-67a4c914a250 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:49.021848 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2654cf30-0094-4fbd-adbf-67a4c914a250 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:49.022226 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2654cf30-0094-4fbd-adbf-67a4c914a250 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:49.022922 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2654cf30-0094-4fbd-adbf-67a4c914a250 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:49.023362 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2654cf30-0094-4fbd-adbf-67a4c914a250 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:49.023816 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2654cf30-0094-4fbd-adbf-67a4c914a250 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:49.164394 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-2654cf30-0094-4fbd-adbf-67a4c914a250 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:49.177456 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-2654cf30-0094-4fbd-adbf-67a4c914a250 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:49.178963 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-2654cf30-0094-4fbd-adbf-67a4c914a250 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:49.180460 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-2654cf30-0094-4fbd-adbf-67a4c914a250 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1810 microversion: 2.20 time: 0.171291 Aug 12 01:30:49.181049 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 218/447] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:49 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:30:49.819874 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-9b711c11-8e64-4d29-8b83-16b025af55cf tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:49.820502 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-9b711c11-8e64-4d29-8b83-16b025af55cf tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: ecabacb5-7e74-412d-990b-52e1181cba09] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:49.827211 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9b711c11-8e64-4d29-8b83-16b025af55cf tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:49.827698 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9b711c11-8e64-4d29-8b83-16b025af55cf tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:49.828146 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9b711c11-8e64-4d29-8b83-16b025af55cf tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:49.828928 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9b711c11-8e64-4d29-8b83-16b025af55cf tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:49.829372 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9b711c11-8e64-4d29-8b83-16b025af55cf tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:49.829789 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9b711c11-8e64-4d29-8b83-16b025af55cf tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:49.975931 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-9b711c11-8e64-4d29-8b83-16b025af55cf tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:49.983250 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-9b711c11-8e64-4d29-8b83-16b025af55cf tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09" status: 200 len: 1314 microversion: 2.1 time: 0.167399 Aug 12 01:30:49.983844 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 230/448] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:49 2022] GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:50.203314 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-5cb5e6cc-ca5a-4386-8219-280d2d71f468 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:50.204025 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-5cb5e6cc-ca5a-4386-8219-280d2d71f468 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:50.211620 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5cb5e6cc-ca5a-4386-8219-280d2d71f468 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:50.212114 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5cb5e6cc-ca5a-4386-8219-280d2d71f468 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:50.212546 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5cb5e6cc-ca5a-4386-8219-280d2d71f468 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:50.213219 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5cb5e6cc-ca5a-4386-8219-280d2d71f468 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:50.213809 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5cb5e6cc-ca5a-4386-8219-280d2d71f468 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:50.214118 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5cb5e6cc-ca5a-4386-8219-280d2d71f468 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:50.368352 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-5cb5e6cc-ca5a-4386-8219-280d2d71f468 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:50.377338 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-5cb5e6cc-ca5a-4386-8219-280d2d71f468 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:50.378830 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-5cb5e6cc-ca5a-4386-8219-280d2d71f468 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:50.380050 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-5cb5e6cc-ca5a-4386-8219-280d2d71f468 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1810 microversion: 2.20 time: 0.180704 Aug 12 01:30:50.395886 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 219/449] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:50 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1810 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:30:51.003906 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-a0b2ea64-5ed1-4e46-baad-17cf4d5c595c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:51.004641 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-a0b2ea64-5ed1-4e46-baad-17cf4d5c595c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: ecabacb5-7e74-412d-990b-52e1181cba09] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:51.020297 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a0b2ea64-5ed1-4e46-baad-17cf4d5c595c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:51.020781 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a0b2ea64-5ed1-4e46-baad-17cf4d5c595c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:51.021225 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a0b2ea64-5ed1-4e46-baad-17cf4d5c595c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:51.021907 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a0b2ea64-5ed1-4e46-baad-17cf4d5c595c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:51.022346 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a0b2ea64-5ed1-4e46-baad-17cf4d5c595c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:51.022760 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a0b2ea64-5ed1-4e46-baad-17cf4d5c595c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:51.180816 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-a0b2ea64-5ed1-4e46-baad-17cf4d5c595c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:51.188666 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-a0b2ea64-5ed1-4e46-baad-17cf4d5c595c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09" status: 200 len: 1314 microversion: 2.1 time: 0.188874 Aug 12 01:30:51.189241 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 231/450] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:50 2022] GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:51.404850 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-e451efb7-cfe8-4ee9-a2e3-020b11ebf38b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:51.407552 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-e451efb7-cfe8-4ee9-a2e3-020b11ebf38b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:51.416541 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e451efb7-cfe8-4ee9-a2e3-020b11ebf38b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:51.417023 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e451efb7-cfe8-4ee9-a2e3-020b11ebf38b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:51.417447 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e451efb7-cfe8-4ee9-a2e3-020b11ebf38b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:51.418151 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e451efb7-cfe8-4ee9-a2e3-020b11ebf38b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:51.418590 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e451efb7-cfe8-4ee9-a2e3-020b11ebf38b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:51.419002 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e451efb7-cfe8-4ee9-a2e3-020b11ebf38b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:51.570953 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-e451efb7-cfe8-4ee9-a2e3-020b11ebf38b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:51.580170 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-e451efb7-cfe8-4ee9-a2e3-020b11ebf38b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:51.581657 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-e451efb7-cfe8-4ee9-a2e3-020b11ebf38b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:51.582827 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-e451efb7-cfe8-4ee9-a2e3-020b11ebf38b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1810 microversion: 2.20 time: 0.183938 Aug 12 01:30:51.583392 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 220/451] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:51 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1810 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 01:30:52.209572 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-372fee8e-7bee-4c3b-99ad-c5699e8643ca tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:52.210201 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-372fee8e-7bee-4c3b-99ad-c5699e8643ca tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: ecabacb5-7e74-412d-990b-52e1181cba09] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:52.217256 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-372fee8e-7bee-4c3b-99ad-c5699e8643ca tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:52.217747 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-372fee8e-7bee-4c3b-99ad-c5699e8643ca tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:52.218194 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-372fee8e-7bee-4c3b-99ad-c5699e8643ca tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:52.218899 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-372fee8e-7bee-4c3b-99ad-c5699e8643ca tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:52.219519 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-372fee8e-7bee-4c3b-99ad-c5699e8643ca tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:52.219869 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-372fee8e-7bee-4c3b-99ad-c5699e8643ca tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:52.224108 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:52.366844 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-372fee8e-7bee-4c3b-99ad-c5699e8643ca tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:52.375700 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-372fee8e-7bee-4c3b-99ad-c5699e8643ca tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09" status: 200 len: 1314 microversion: 2.1 time: 0.169898 Aug 12 01:30:52.377271 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 232/452] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:52 2022] GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:52.606663 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-c540c6f5-01b6-4442-96e3-5cbcba9e4f95 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:52.608020 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-c540c6f5-01b6-4442-96e3-5cbcba9e4f95 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:52.622348 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c540c6f5-01b6-4442-96e3-5cbcba9e4f95 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:52.623747 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c540c6f5-01b6-4442-96e3-5cbcba9e4f95 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:52.624306 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c540c6f5-01b6-4442-96e3-5cbcba9e4f95 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:52.625040 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c540c6f5-01b6-4442-96e3-5cbcba9e4f95 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:52.625496 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c540c6f5-01b6-4442-96e3-5cbcba9e4f95 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:52.625919 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c540c6f5-01b6-4442-96e3-5cbcba9e4f95 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:52.763965 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-c540c6f5-01b6-4442-96e3-5cbcba9e4f95 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:52.772591 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-c540c6f5-01b6-4442-96e3-5cbcba9e4f95 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:52.774101 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-c540c6f5-01b6-4442-96e3-5cbcba9e4f95 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:52.775271 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-c540c6f5-01b6-4442-96e3-5cbcba9e4f95 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1810 microversion: 2.20 time: 0.172913 Aug 12 01:30:52.776079 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 221/453] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:52 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:30:53.398195 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-c52d8c1e-4b10-4c82-9729-0651e5c7c985 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:53.398778 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-c52d8c1e-4b10-4c82-9729-0651e5c7c985 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: ecabacb5-7e74-412d-990b-52e1181cba09] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:53.405579 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c52d8c1e-4b10-4c82-9729-0651e5c7c985 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:53.406061 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c52d8c1e-4b10-4c82-9729-0651e5c7c985 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:53.406499 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c52d8c1e-4b10-4c82-9729-0651e5c7c985 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:53.407141 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c52d8c1e-4b10-4c82-9729-0651e5c7c985 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:53.407616 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c52d8c1e-4b10-4c82-9729-0651e5c7c985 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:53.408027 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c52d8c1e-4b10-4c82-9729-0651e5c7c985 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:53.543615 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-c52d8c1e-4b10-4c82-9729-0651e5c7c985 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:53.553944 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-c52d8c1e-4b10-4c82-9729-0651e5c7c985 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09" status: 200 len: 1314 microversion: 2.1 time: 0.159660 Aug 12 01:30:53.554516 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 233/454] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:53 2022] GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:53.798865 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-f341b95d-5a92-4ace-938c-ac0cea6c41d7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:53.799458 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-f341b95d-5a92-4ace-938c-ac0cea6c41d7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:53.806492 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f341b95d-5a92-4ace-938c-ac0cea6c41d7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:53.806969 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f341b95d-5a92-4ace-938c-ac0cea6c41d7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:53.807370 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f341b95d-5a92-4ace-938c-ac0cea6c41d7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:53.808084 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f341b95d-5a92-4ace-938c-ac0cea6c41d7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:53.808531 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f341b95d-5a92-4ace-938c-ac0cea6c41d7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:53.808948 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f341b95d-5a92-4ace-938c-ac0cea6c41d7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:53.955875 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-f341b95d-5a92-4ace-938c-ac0cea6c41d7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:53.964248 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-f341b95d-5a92-4ace-938c-ac0cea6c41d7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:53.965723 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-f341b95d-5a92-4ace-938c-ac0cea6c41d7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:53.966924 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-f341b95d-5a92-4ace-938c-ac0cea6c41d7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1810 microversion: 2.20 time: 0.172321 Aug 12 01:30:53.967477 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 222/455] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:53 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:30:54.575081 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-d600038e-94c3-4429-90b5-3c00abcf8b4c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:54.576052 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-d600038e-94c3-4429-90b5-3c00abcf8b4c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: ecabacb5-7e74-412d-990b-52e1181cba09] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:54.587486 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d600038e-94c3-4429-90b5-3c00abcf8b4c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:54.588090 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d600038e-94c3-4429-90b5-3c00abcf8b4c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:54.588644 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d600038e-94c3-4429-90b5-3c00abcf8b4c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:54.589491 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d600038e-94c3-4429-90b5-3c00abcf8b4c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:54.589997 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d600038e-94c3-4429-90b5-3c00abcf8b4c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:54.590407 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d600038e-94c3-4429-90b5-3c00abcf8b4c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:54.757718 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-d600038e-94c3-4429-90b5-3c00abcf8b4c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:54.770176 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-d600038e-94c3-4429-90b5-3c00abcf8b4c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09" status: 200 len: 1314 microversion: 2.1 time: 0.199111 Aug 12 01:30:54.770947 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 234/456] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:54 2022] GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:54.992361 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-93c9fcb3-dfe4-432a-a28c-6bd21b5e4f41 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:54.992982 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-93c9fcb3-dfe4-432a-a28c-6bd21b5e4f41 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:54.999513 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-93c9fcb3-dfe4-432a-a28c-6bd21b5e4f41 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:55.001065 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-93c9fcb3-dfe4-432a-a28c-6bd21b5e4f41 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:55.001673 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-93c9fcb3-dfe4-432a-a28c-6bd21b5e4f41 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:55.002405 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-93c9fcb3-dfe4-432a-a28c-6bd21b5e4f41 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:55.002852 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-93c9fcb3-dfe4-432a-a28c-6bd21b5e4f41 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:55.003266 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-93c9fcb3-dfe4-432a-a28c-6bd21b5e4f41 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:55.145258 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-93c9fcb3-dfe4-432a-a28c-6bd21b5e4f41 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:55.156095 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-93c9fcb3-dfe4-432a-a28c-6bd21b5e4f41 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:55.157674 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-93c9fcb3-dfe4-432a-a28c-6bd21b5e4f41 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:55.158853 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-93c9fcb3-dfe4-432a-a28c-6bd21b5e4f41 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1810 microversion: 2.20 time: 0.170432 Aug 12 01:30:55.160272 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 223/457] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:54 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1810 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:30:55.790689 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-e7901a92-80d8-4640-b65a-51c9067277da tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:55.791359 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-e7901a92-80d8-4640-b65a-51c9067277da tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: ecabacb5-7e74-412d-990b-52e1181cba09] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:55.798120 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e7901a92-80d8-4640-b65a-51c9067277da tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:55.798616 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e7901a92-80d8-4640-b65a-51c9067277da tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:55.799041 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e7901a92-80d8-4640-b65a-51c9067277da tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:55.799829 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e7901a92-80d8-4640-b65a-51c9067277da tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:55.800276 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e7901a92-80d8-4640-b65a-51c9067277da tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:55.800699 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e7901a92-80d8-4640-b65a-51c9067277da tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:55.912260 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-fdbd68f7-225e-4ffe-a67b-73bed62adc6a tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:30:55.915210 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-fdbd68f7-225e-4ffe-a67b-73bed62adc6a tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:55.925698 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-fdbd68f7-225e-4ffe-a67b-73bed62adc6a tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:55.926186 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-fdbd68f7-225e-4ffe-a67b-73bed62adc6a tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:55.927057 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-fdbd68f7-225e-4ffe-a67b-73bed62adc6a tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:55.928964 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-fdbd68f7-225e-4ffe-a67b-73bed62adc6a tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:55.929482 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-fdbd68f7-225e-4ffe-a67b-73bed62adc6a tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:55.930225 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-fdbd68f7-225e-4ffe-a67b-73bed62adc6a tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:55.955714 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-e7901a92-80d8-4640-b65a-51c9067277da tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:55.963473 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-e7901a92-80d8-4640-b65a-51c9067277da tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09" status: 200 len: 1314 microversion: 2.1 time: 0.176633 Aug 12 01:30:55.964285 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 235/458] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:55 2022] GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:56.018107 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-fdbd68f7-225e-4ffe-a67b-73bed62adc6a tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "POST /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776/action" status: 202 len: 0 microversion: 2.1 time: 0.110667 Aug 12 01:30:56.018853 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 224/459] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Aug 12 01:30:55 2022] POST /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 01:30:56.027275 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-4f22abbf-564a-41d5-b94e-ea1cbcc1c7c7 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:56.029073 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-4f22abbf-564a-41d5-b94e-ea1cbcc1c7c7 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:56.035655 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4f22abbf-564a-41d5-b94e-ea1cbcc1c7c7 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:56.036203 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4f22abbf-564a-41d5-b94e-ea1cbcc1c7c7 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:56.037129 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4f22abbf-564a-41d5-b94e-ea1cbcc1c7c7 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:56.037624 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4f22abbf-564a-41d5-b94e-ea1cbcc1c7c7 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:56.038153 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4f22abbf-564a-41d5-b94e-ea1cbcc1c7c7 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:56.038632 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4f22abbf-564a-41d5-b94e-ea1cbcc1c7c7 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:56.182919 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-5d4b3986-4664-479f-bf76-945a80bf4cf6 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:56.184450 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-5d4b3986-4664-479f-bf76-945a80bf4cf6 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:56.190597 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-4f22abbf-564a-41d5-b94e-ea1cbcc1c7c7 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:56.196690 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5d4b3986-4664-479f-bf76-945a80bf4cf6 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:56.197270 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5d4b3986-4664-479f-bf76-945a80bf4cf6 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:56.197794 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5d4b3986-4664-479f-bf76-945a80bf4cf6 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:56.198585 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5d4b3986-4664-479f-bf76-945a80bf4cf6 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:56.199100 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5d4b3986-4664-479f-bf76-945a80bf4cf6 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:56.199766 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5d4b3986-4664-479f-bf76-945a80bf4cf6 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:56.201364 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-4f22abbf-564a-41d5-b94e-ea1cbcc1c7c7 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1751 microversion: 2.1 time: 0.178066 Aug 12 01:30:56.203218 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 236/460] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:56 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1751 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:56.343209 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-5d4b3986-4664-479f-bf76-945a80bf4cf6 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:56.357588 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-5d4b3986-4664-479f-bf76-945a80bf4cf6 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:56.359220 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-5d4b3986-4664-479f-bf76-945a80bf4cf6 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:56.360562 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-5d4b3986-4664-479f-bf76-945a80bf4cf6 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1810 microversion: 2.20 time: 0.182338 Aug 12 01:30:56.361099 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 225/461] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:56 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1810 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 01:30:56.985223 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-5a902f41-7fb3-44e4-b91a-064b5c025f35 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:56.985808 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-5a902f41-7fb3-44e4-b91a-064b5c025f35 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: ecabacb5-7e74-412d-990b-52e1181cba09] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:56.992423 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5a902f41-7fb3-44e4-b91a-064b5c025f35 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:56.992904 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5a902f41-7fb3-44e4-b91a-064b5c025f35 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:56.993462 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5a902f41-7fb3-44e4-b91a-064b5c025f35 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:56.994243 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5a902f41-7fb3-44e4-b91a-064b5c025f35 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:56.994689 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5a902f41-7fb3-44e4-b91a-064b5c025f35 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:56.995101 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5a902f41-7fb3-44e4-b91a-064b5c025f35 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:57.134554 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-5a902f41-7fb3-44e4-b91a-064b5c025f35 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:57.143937 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-5a902f41-7fb3-44e4-b91a-064b5c025f35 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09" status: 200 len: 1314 microversion: 2.1 time: 0.163437 Aug 12 01:30:57.145158 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 237/462] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:56 2022] GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:57.223770 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-b48af0a5-7522-4254-b3df-6bfd75896b24 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:57.224457 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-b48af0a5-7522-4254-b3df-6bfd75896b24 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:57.232967 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b48af0a5-7522-4254-b3df-6bfd75896b24 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:57.233447 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b48af0a5-7522-4254-b3df-6bfd75896b24 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:57.233872 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b48af0a5-7522-4254-b3df-6bfd75896b24 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:57.234582 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b48af0a5-7522-4254-b3df-6bfd75896b24 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:57.235051 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b48af0a5-7522-4254-b3df-6bfd75896b24 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:57.235520 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b48af0a5-7522-4254-b3df-6bfd75896b24 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:57.383942 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-a276c54c-b2b0-4048-8970-509f15e1e040 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:57.384548 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-a276c54c-b2b0-4048-8970-509f15e1e040 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:57.384945 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-b48af0a5-7522-4254-b3df-6bfd75896b24 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:57.390739 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a276c54c-b2b0-4048-8970-509f15e1e040 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:57.391470 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a276c54c-b2b0-4048-8970-509f15e1e040 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:57.391951 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a276c54c-b2b0-4048-8970-509f15e1e040 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:57.392635 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a276c54c-b2b0-4048-8970-509f15e1e040 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:57.393072 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a276c54c-b2b0-4048-8970-509f15e1e040 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:57.393180 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-b48af0a5-7522-4254-b3df-6bfd75896b24 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1751 microversion: 2.1 time: 0.173370 Aug 12 01:30:57.393483 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a276c54c-b2b0-4048-8970-509f15e1e040 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:57.393736 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 226/463] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:57 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:57.530755 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-a276c54c-b2b0-4048-8970-509f15e1e040 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:57.535883 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-a276c54c-b2b0-4048-8970-509f15e1e040 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:57.537503 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-a276c54c-b2b0-4048-8970-509f15e1e040 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:57.538552 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-a276c54c-b2b0-4048-8970-509f15e1e040 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1810 microversion: 2.20 time: 0.158840 Aug 12 01:30:57.539353 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 238/464] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:57 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:30:58.164960 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-f0bfd3af-6ed7-40aa-b1b3-58f5b203086b tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:58.168769 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-f0bfd3af-6ed7-40aa-b1b3-58f5b203086b tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: ecabacb5-7e74-412d-990b-52e1181cba09] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:58.175076 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f0bfd3af-6ed7-40aa-b1b3-58f5b203086b tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:58.175836 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f0bfd3af-6ed7-40aa-b1b3-58f5b203086b tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:58.176447 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f0bfd3af-6ed7-40aa-b1b3-58f5b203086b tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:58.177177 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f0bfd3af-6ed7-40aa-b1b3-58f5b203086b tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:58.177681 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f0bfd3af-6ed7-40aa-b1b3-58f5b203086b tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:58.178102 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f0bfd3af-6ed7-40aa-b1b3-58f5b203086b tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:58.389643 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-f0bfd3af-6ed7-40aa-b1b3-58f5b203086b tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:58.397408 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-f0bfd3af-6ed7-40aa-b1b3-58f5b203086b tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09" status: 200 len: 1314 microversion: 2.1 time: 0.236303 Aug 12 01:30:58.398785 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 227/465] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:58 2022] GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:58.414316 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-62c684e5-bf75-4c2c-9a19-88aac9cc9246 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:58.414929 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-62c684e5-bf75-4c2c-9a19-88aac9cc9246 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:58.421750 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-62c684e5-bf75-4c2c-9a19-88aac9cc9246 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:58.422343 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-62c684e5-bf75-4c2c-9a19-88aac9cc9246 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:58.422782 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-62c684e5-bf75-4c2c-9a19-88aac9cc9246 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:58.423476 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-62c684e5-bf75-4c2c-9a19-88aac9cc9246 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:58.423961 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-62c684e5-bf75-4c2c-9a19-88aac9cc9246 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:58.424378 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-62c684e5-bf75-4c2c-9a19-88aac9cc9246 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:58.560760 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-9d3efe96-9bf2-4ee4-97ae-cf34500044d4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:58.561371 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-9d3efe96-9bf2-4ee4-97ae-cf34500044d4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:58.568015 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9d3efe96-9bf2-4ee4-97ae-cf34500044d4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:58.568367 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9d3efe96-9bf2-4ee4-97ae-cf34500044d4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:58.568777 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9d3efe96-9bf2-4ee4-97ae-cf34500044d4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:58.569480 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9d3efe96-9bf2-4ee4-97ae-cf34500044d4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:58.569925 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9d3efe96-9bf2-4ee4-97ae-cf34500044d4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:58.570345 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9d3efe96-9bf2-4ee4-97ae-cf34500044d4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:58.570599 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-62c684e5-bf75-4c2c-9a19-88aac9cc9246 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:58.574732 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:58.579425 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-62c684e5-bf75-4c2c-9a19-88aac9cc9246 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1751 microversion: 2.1 time: 0.168939 Aug 12 01:30:58.580025 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 239/466] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:58 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:58.710814 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-9d3efe96-9bf2-4ee4-97ae-cf34500044d4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:58.719647 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-9d3efe96-9bf2-4ee4-97ae-cf34500044d4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:58.721147 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-9d3efe96-9bf2-4ee4-97ae-cf34500044d4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:58.722314 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-9d3efe96-9bf2-4ee4-97ae-cf34500044d4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1810 microversion: 2.20 time: 0.165576 Aug 12 01:30:58.722863 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 228/467] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:58 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 01:30:59.420211 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-66d51173-2562-460f-b8ac-6a8959a62edc tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:59.420885 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-66d51173-2562-460f-b8ac-6a8959a62edc tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: ecabacb5-7e74-412d-990b-52e1181cba09] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:59.428180 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-66d51173-2562-460f-b8ac-6a8959a62edc tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:59.428675 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-66d51173-2562-460f-b8ac-6a8959a62edc tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:59.429257 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-66d51173-2562-460f-b8ac-6a8959a62edc tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:59.430273 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-66d51173-2562-460f-b8ac-6a8959a62edc tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:59.430871 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-66d51173-2562-460f-b8ac-6a8959a62edc tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:59.431429 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-66d51173-2562-460f-b8ac-6a8959a62edc tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:59.570272 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-66d51173-2562-460f-b8ac-6a8959a62edc tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:59.578680 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-66d51173-2562-460f-b8ac-6a8959a62edc tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09" status: 200 len: 1499 microversion: 2.1 time: 0.162431 Aug 12 01:30:59.579289 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 240/468] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:59 2022] GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09 => generated 1499 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:59.601959 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-debc643a-1218-4dc6-afa0-a27a555e6b73 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:59.602567 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-debc643a-1218-4dc6-afa0-a27a555e6b73 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:59.610339 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-debc643a-1218-4dc6-afa0-a27a555e6b73 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:59.610762 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-debc643a-1218-4dc6-afa0-a27a555e6b73 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:59.611192 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-debc643a-1218-4dc6-afa0-a27a555e6b73 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:59.611914 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-debc643a-1218-4dc6-afa0-a27a555e6b73 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:59.612368 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-debc643a-1218-4dc6-afa0-a27a555e6b73 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:59.612815 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-debc643a-1218-4dc6-afa0-a27a555e6b73 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:59.745930 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-e9a8681c-846c-4974-8ec9-d0aa885896f9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:30:59.746665 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-e9a8681c-846c-4974-8ec9-d0aa885896f9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:30:59.754446 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e9a8681c-846c-4974-8ec9-d0aa885896f9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:59.754977 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e9a8681c-846c-4974-8ec9-d0aa885896f9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:59.755409 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e9a8681c-846c-4974-8ec9-d0aa885896f9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:59.756189 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e9a8681c-846c-4974-8ec9-d0aa885896f9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:30:59.757333 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e9a8681c-846c-4974-8ec9-d0aa885896f9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:30:59.757333 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e9a8681c-846c-4974-8ec9-d0aa885896f9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:30:59.781922 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-debc643a-1218-4dc6-afa0-a27a555e6b73 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:59.791628 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-debc643a-1218-4dc6-afa0-a27a555e6b73 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1756 microversion: 2.1 time: 0.194470 Aug 12 01:30:59.792513 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 229/469] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:30:59 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1756 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:30:59.911996 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-e9a8681c-846c-4974-8ec9-d0aa885896f9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:59.923051 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-e9a8681c-846c-4974-8ec9-d0aa885896f9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:59.924778 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-e9a8681c-846c-4974-8ec9-d0aa885896f9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:30:59.926092 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-e9a8681c-846c-4974-8ec9-d0aa885896f9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1810 microversion: 2.20 time: 0.184790 Aug 12 01:30:59.926650 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 241/470] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:30:59 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1810 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:31:00.170024 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-d83652a1-fb23-4e92-94cb-f2eec4025446 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:00.170509 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-d83652a1-fb23-4e92-94cb-f2eec4025446 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: ecabacb5-7e74-412d-990b-52e1181cba09] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:00.176691 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d83652a1-fb23-4e92-94cb-f2eec4025446 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:00.177191 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d83652a1-fb23-4e92-94cb-f2eec4025446 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:00.177617 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d83652a1-fb23-4e92-94cb-f2eec4025446 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:00.178302 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d83652a1-fb23-4e92-94cb-f2eec4025446 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:00.178738 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d83652a1-fb23-4e92-94cb-f2eec4025446 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:00.179151 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d83652a1-fb23-4e92-94cb-f2eec4025446 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:00.204761 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-d83652a1-fb23-4e92-94cb-f2eec4025446 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: ecabacb5-7e74-412d-990b-52e1181cba09] Going to try to terminate instance {{(pid=120785) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 01:31:00.282278 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-d83652a1-fb23-4e92-94cb-f2eec4025446 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09" status: 204 len: 0 microversion: 2.1 time: 0.115641 Aug 12 01:31:00.283183 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 230/471] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 01:31:00 2022] DELETE /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 01:31:00.294098 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-9e3ea202-461e-4a4d-b86f-1e1d6b968c4d tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:00.294737 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-9e3ea202-461e-4a4d-b86f-1e1d6b968c4d tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: ecabacb5-7e74-412d-990b-52e1181cba09] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:00.303775 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9e3ea202-461e-4a4d-b86f-1e1d6b968c4d tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:00.304415 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9e3ea202-461e-4a4d-b86f-1e1d6b968c4d tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:00.305473 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9e3ea202-461e-4a4d-b86f-1e1d6b968c4d tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:00.306161 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9e3ea202-461e-4a4d-b86f-1e1d6b968c4d tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:00.306608 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9e3ea202-461e-4a4d-b86f-1e1d6b968c4d tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:00.307566 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9e3ea202-461e-4a4d-b86f-1e1d6b968c4d tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:00.451281 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-9e3ea202-461e-4a4d-b86f-1e1d6b968c4d tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:00.459189 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-9e3ea202-461e-4a4d-b86f-1e1d6b968c4d tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09" status: 200 len: 1505 microversion: 2.1 time: 0.171899 Aug 12 01:31:00.459802 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 242/472] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:00 2022] GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09 => generated 1505 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:00.815243 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-288ee2f5-0bab-43b6-a62c-fbb7facb6ba3 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:00.816010 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-288ee2f5-0bab-43b6-a62c-fbb7facb6ba3 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:00.822889 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-288ee2f5-0bab-43b6-a62c-fbb7facb6ba3 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:00.823369 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-288ee2f5-0bab-43b6-a62c-fbb7facb6ba3 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:00.823896 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-288ee2f5-0bab-43b6-a62c-fbb7facb6ba3 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:00.824578 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-288ee2f5-0bab-43b6-a62c-fbb7facb6ba3 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:00.825025 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-288ee2f5-0bab-43b6-a62c-fbb7facb6ba3 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:00.825474 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-288ee2f5-0bab-43b6-a62c-fbb7facb6ba3 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:00.952112 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-48bb0bae-5ea0-41df-8da5-59e1eea37d2e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:00.952725 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-48bb0bae-5ea0-41df-8da5-59e1eea37d2e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:00.959255 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-48bb0bae-5ea0-41df-8da5-59e1eea37d2e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:00.959782 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-48bb0bae-5ea0-41df-8da5-59e1eea37d2e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:00.960631 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-48bb0bae-5ea0-41df-8da5-59e1eea37d2e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:00.961339 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-48bb0bae-5ea0-41df-8da5-59e1eea37d2e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:00.961787 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-48bb0bae-5ea0-41df-8da5-59e1eea37d2e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:00.962206 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-48bb0bae-5ea0-41df-8da5-59e1eea37d2e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:00.980124 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-288ee2f5-0bab-43b6-a62c-fbb7facb6ba3 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:00.989365 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-288ee2f5-0bab-43b6-a62c-fbb7facb6ba3 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1756 microversion: 2.1 time: 0.178365 Aug 12 01:31:00.989901 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 231/473] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:00 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:01.107339 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-48bb0bae-5ea0-41df-8da5-59e1eea37d2e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:01.116084 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-48bb0bae-5ea0-41df-8da5-59e1eea37d2e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:01.117615 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-48bb0bae-5ea0-41df-8da5-59e1eea37d2e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:01.118780 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-48bb0bae-5ea0-41df-8da5-59e1eea37d2e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1810 microversion: 2.20 time: 0.172768 Aug 12 01:31:01.119341 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 243/474] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:31:00 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:31:01.479419 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-c6d8d292-d904-4aa9-bd2b-d14914f2965c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:01.480049 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-c6d8d292-d904-4aa9-bd2b-d14914f2965c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: ecabacb5-7e74-412d-990b-52e1181cba09] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:01.486183 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c6d8d292-d904-4aa9-bd2b-d14914f2965c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:01.486699 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c6d8d292-d904-4aa9-bd2b-d14914f2965c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:01.487126 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c6d8d292-d904-4aa9-bd2b-d14914f2965c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:01.487841 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c6d8d292-d904-4aa9-bd2b-d14914f2965c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:01.488290 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c6d8d292-d904-4aa9-bd2b-d14914f2965c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:01.488735 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c6d8d292-d904-4aa9-bd2b-d14914f2965c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:01.619059 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-c6d8d292-d904-4aa9-bd2b-d14914f2965c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:01.627136 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-c6d8d292-d904-4aa9-bd2b-d14914f2965c tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09" status: 200 len: 1505 microversion: 2.1 time: 0.151698 Aug 12 01:31:01.627968 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 232/475] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:01 2022] GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:02.011648 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-7e8bdae4-e607-4fc0-aa20-453f9cbdbc56 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:02.012331 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-7e8bdae4-e607-4fc0-aa20-453f9cbdbc56 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:02.021781 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7e8bdae4-e607-4fc0-aa20-453f9cbdbc56 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:02.022494 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7e8bdae4-e607-4fc0-aa20-453f9cbdbc56 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:02.023153 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7e8bdae4-e607-4fc0-aa20-453f9cbdbc56 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:02.024301 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7e8bdae4-e607-4fc0-aa20-453f9cbdbc56 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:02.024952 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7e8bdae4-e607-4fc0-aa20-453f9cbdbc56 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:02.025634 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7e8bdae4-e607-4fc0-aa20-453f9cbdbc56 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:02.141387 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-363c279e-af1f-48c3-b96d-ec174a95b049 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:02.142001 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-363c279e-af1f-48c3-b96d-ec174a95b049 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:02.148429 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-363c279e-af1f-48c3-b96d-ec174a95b049 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:02.148914 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-363c279e-af1f-48c3-b96d-ec174a95b049 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:02.149341 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-363c279e-af1f-48c3-b96d-ec174a95b049 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:02.150035 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-363c279e-af1f-48c3-b96d-ec174a95b049 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:02.150482 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-363c279e-af1f-48c3-b96d-ec174a95b049 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:02.150904 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-363c279e-af1f-48c3-b96d-ec174a95b049 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:02.182938 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-7e8bdae4-e607-4fc0-aa20-453f9cbdbc56 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:02.191304 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-7e8bdae4-e607-4fc0-aa20-453f9cbdbc56 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1756 microversion: 2.1 time: 0.184748 Aug 12 01:31:02.192076 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 244/476] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:02 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:02.289462 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-363c279e-af1f-48c3-b96d-ec174a95b049 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:02.297999 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-363c279e-af1f-48c3-b96d-ec174a95b049 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:02.299504 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-363c279e-af1f-48c3-b96d-ec174a95b049 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:02.300892 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-363c279e-af1f-48c3-b96d-ec174a95b049 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1810 microversion: 2.20 time: 0.163547 Aug 12 01:31:02.301472 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 233/477] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:31:02 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 01:31:02.648941 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-cbe5b32f-5555-44c4-9858-07c1ea4c2bfe tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:02.649641 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-cbe5b32f-5555-44c4-9858-07c1ea4c2bfe tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: ecabacb5-7e74-412d-990b-52e1181cba09] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:02.655746 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cbe5b32f-5555-44c4-9858-07c1ea4c2bfe tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:02.656214 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cbe5b32f-5555-44c4-9858-07c1ea4c2bfe tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:02.656797 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cbe5b32f-5555-44c4-9858-07c1ea4c2bfe tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:02.657908 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cbe5b32f-5555-44c4-9858-07c1ea4c2bfe tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:02.658738 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cbe5b32f-5555-44c4-9858-07c1ea4c2bfe tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:02.659390 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cbe5b32f-5555-44c4-9858-07c1ea4c2bfe tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:02.794562 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-cbe5b32f-5555-44c4-9858-07c1ea4c2bfe tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:02.802374 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-cbe5b32f-5555-44c4-9858-07c1ea4c2bfe tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09" status: 200 len: 1505 microversion: 2.1 time: 0.157354 Aug 12 01:31:02.802945 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 245/478] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:02 2022] GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:03.217087 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-295cbaa4-48e0-4b04-8452-0f36460339b5 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:03.218049 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-295cbaa4-48e0-4b04-8452-0f36460339b5 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:03.230437 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-295cbaa4-48e0-4b04-8452-0f36460339b5 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:03.231215 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-295cbaa4-48e0-4b04-8452-0f36460339b5 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:03.231970 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-295cbaa4-48e0-4b04-8452-0f36460339b5 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:03.233082 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-295cbaa4-48e0-4b04-8452-0f36460339b5 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:03.233818 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-295cbaa4-48e0-4b04-8452-0f36460339b5 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:03.234644 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-295cbaa4-48e0-4b04-8452-0f36460339b5 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:03.323326 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-e7ab22ef-6890-4ca7-86a1-8b796cc9bdb4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:03.323961 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-e7ab22ef-6890-4ca7-86a1-8b796cc9bdb4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:03.330939 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e7ab22ef-6890-4ca7-86a1-8b796cc9bdb4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:03.331425 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e7ab22ef-6890-4ca7-86a1-8b796cc9bdb4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:03.331892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e7ab22ef-6890-4ca7-86a1-8b796cc9bdb4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:03.332596 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e7ab22ef-6890-4ca7-86a1-8b796cc9bdb4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:03.333043 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e7ab22ef-6890-4ca7-86a1-8b796cc9bdb4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:03.333464 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e7ab22ef-6890-4ca7-86a1-8b796cc9bdb4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:03.391112 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-295cbaa4-48e0-4b04-8452-0f36460339b5 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:03.399253 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-295cbaa4-48e0-4b04-8452-0f36460339b5 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1756 microversion: 2.1 time: 0.188603 Aug 12 01:31:03.399843 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 234/479] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:03 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:03.475654 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-e7ab22ef-6890-4ca7-86a1-8b796cc9bdb4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:03.484616 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-e7ab22ef-6890-4ca7-86a1-8b796cc9bdb4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:03.486090 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-e7ab22ef-6890-4ca7-86a1-8b796cc9bdb4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:03.487249 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-e7ab22ef-6890-4ca7-86a1-8b796cc9bdb4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1810 microversion: 2.20 time: 0.167865 Aug 12 01:31:03.487837 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 246/480] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:31:03 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:31:03.826715 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-92950c7a-c8fe-404a-bb58-0f4d6ed1d76f tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:03.827399 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-92950c7a-c8fe-404a-bb58-0f4d6ed1d76f tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: ecabacb5-7e74-412d-990b-52e1181cba09] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:03.834208 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-92950c7a-c8fe-404a-bb58-0f4d6ed1d76f tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:03.834696 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-92950c7a-c8fe-404a-bb58-0f4d6ed1d76f tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:03.835129 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-92950c7a-c8fe-404a-bb58-0f4d6ed1d76f tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:03.835868 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-92950c7a-c8fe-404a-bb58-0f4d6ed1d76f tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:03.836325 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-92950c7a-c8fe-404a-bb58-0f4d6ed1d76f tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:03.836749 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-92950c7a-c8fe-404a-bb58-0f4d6ed1d76f tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:03.972048 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-92950c7a-c8fe-404a-bb58-0f4d6ed1d76f tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:03.980099 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-92950c7a-c8fe-404a-bb58-0f4d6ed1d76f tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09" status: 200 len: 1505 microversion: 2.1 time: 0.159314 Aug 12 01:31:03.980636 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 235/481] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:03 2022] GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09 => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:04.420985 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-d77e80dd-c325-4220-ad0e-9ccd7ee36bc3 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:04.421676 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-d77e80dd-c325-4220-ad0e-9ccd7ee36bc3 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:04.428271 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d77e80dd-c325-4220-ad0e-9ccd7ee36bc3 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:04.428752 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d77e80dd-c325-4220-ad0e-9ccd7ee36bc3 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:04.429187 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d77e80dd-c325-4220-ad0e-9ccd7ee36bc3 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:04.430191 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d77e80dd-c325-4220-ad0e-9ccd7ee36bc3 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:04.430638 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d77e80dd-c325-4220-ad0e-9ccd7ee36bc3 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:04.431053 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d77e80dd-c325-4220-ad0e-9ccd7ee36bc3 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:04.510183 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-6164dcc9-c4aa-4642-99a0-195b1e4f3f3e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:04.511357 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-6164dcc9-c4aa-4642-99a0-195b1e4f3f3e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:04.518062 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6164dcc9-c4aa-4642-99a0-195b1e4f3f3e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:04.518739 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6164dcc9-c4aa-4642-99a0-195b1e4f3f3e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:04.519318 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6164dcc9-c4aa-4642-99a0-195b1e4f3f3e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:04.520374 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6164dcc9-c4aa-4642-99a0-195b1e4f3f3e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:04.520982 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6164dcc9-c4aa-4642-99a0-195b1e4f3f3e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:04.521542 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6164dcc9-c4aa-4642-99a0-195b1e4f3f3e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:04.749308 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-d77e80dd-c325-4220-ad0e-9ccd7ee36bc3 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:04.757784 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-d77e80dd-c325-4220-ad0e-9ccd7ee36bc3 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1756 microversion: 2.1 time: 0.340789 Aug 12 01:31:04.758485 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 247/482] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:04 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1756 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:04.810087 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-6164dcc9-c4aa-4642-99a0-195b1e4f3f3e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:04.819021 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-6164dcc9-c4aa-4642-99a0-195b1e4f3f3e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:04.820595 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-6164dcc9-c4aa-4642-99a0-195b1e4f3f3e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:04.821835 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-6164dcc9-c4aa-4642-99a0-195b1e4f3f3e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1810 microversion: 2.20 time: 0.315519 Aug 12 01:31:04.822415 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 236/483] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:31:04 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1810 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 01:31:05.001390 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-b78f7a65-1472-4693-81f3-05d86ea8519a tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:05.002144 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-b78f7a65-1472-4693-81f3-05d86ea8519a tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: ecabacb5-7e74-412d-990b-52e1181cba09] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:05.008707 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b78f7a65-1472-4693-81f3-05d86ea8519a tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:05.009244 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b78f7a65-1472-4693-81f3-05d86ea8519a tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:05.009738 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b78f7a65-1472-4693-81f3-05d86ea8519a tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:05.010564 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b78f7a65-1472-4693-81f3-05d86ea8519a tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:05.011081 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b78f7a65-1472-4693-81f3-05d86ea8519a tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:05.011563 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b78f7a65-1472-4693-81f3-05d86ea8519a tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:05.091452 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-b78f7a65-1472-4693-81f3-05d86ea8519a tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1242495b42384050a1da78e89821dc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa3549819204b219cbf52a1f9e004e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:05.096200 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell1:SELECT=100 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:05.103096 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-b78f7a65-1472-4693-81f3-05d86ea8519a tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09" status: 200 len: 1463 microversion: 2.1 time: 0.104698 Aug 12 01:31:05.104794 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 248/484] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:04 2022] GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09 => generated 1463 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:05.118112 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-7726b5b0-d48f-403a-bfd4-db911db8c11c req-648bf06f-00f3-4365-b487-1b289ed724c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecabacb5-7e74-412d-990b-52e1181cba09", "name": "network-vif-deleted", "tag": "69a228ea-3a58-4a03-aed1-43d09cbcc476"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:31:05.128186 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-7726b5b0-d48f-403a-bfd4-db911db8c11c req-648bf06f-00f3-4365-b487-1b289ed724c3 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:05.128654 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-7726b5b0-d48f-403a-bfd4-db911db8c11c req-648bf06f-00f3-4365-b487-1b289ed724c3 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:05.129084 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-7726b5b0-d48f-403a-bfd4-db911db8c11c req-648bf06f-00f3-4365-b487-1b289ed724c3 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:05.140868 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-7726b5b0-d48f-403a-bfd4-db911db8c11c req-648bf06f-00f3-4365-b487-1b289ed724c3 service nova] Creating event network-vif-deleted:69a228ea-3a58-4a03-aed1-43d09cbcc476 for instance ecabacb5-7e74-412d-990b-52e1181cba09 on hv-cinder-78481 Aug 12 01:31:05.145788 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-7726b5b0-d48f-403a-bfd4-db911db8c11c req-648bf06f-00f3-4365-b487-1b289ed724c3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044790 Aug 12 01:31:05.146340 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 237/485] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:31:05.778430 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-8cb4783c-72b8-4214-b33f-61d61bafa8d4 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:05.779671 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-8cb4783c-72b8-4214-b33f-61d61bafa8d4 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:05.786916 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8cb4783c-72b8-4214-b33f-61d61bafa8d4 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:05.787452 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8cb4783c-72b8-4214-b33f-61d61bafa8d4 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:05.787912 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8cb4783c-72b8-4214-b33f-61d61bafa8d4 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:05.788600 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8cb4783c-72b8-4214-b33f-61d61bafa8d4 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:05.789045 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8cb4783c-72b8-4214-b33f-61d61bafa8d4 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:05.789478 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8cb4783c-72b8-4214-b33f-61d61bafa8d4 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:05.847272 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-aa83b8f3-6111-40ee-863d-9d2727df9449 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:05.848138 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-aa83b8f3-6111-40ee-863d-9d2727df9449 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:05.855276 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-aa83b8f3-6111-40ee-863d-9d2727df9449 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:05.855796 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-aa83b8f3-6111-40ee-863d-9d2727df9449 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:05.856228 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-aa83b8f3-6111-40ee-863d-9d2727df9449 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:05.856898 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-aa83b8f3-6111-40ee-863d-9d2727df9449 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:05.857380 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-aa83b8f3-6111-40ee-863d-9d2727df9449 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:05.857796 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-aa83b8f3-6111-40ee-863d-9d2727df9449 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:05.990686 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-8cb4783c-72b8-4214-b33f-61d61bafa8d4 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:06.000620 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-8cb4783c-72b8-4214-b33f-61d61bafa8d4 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1756 microversion: 2.1 time: 0.226036 Aug 12 01:31:06.001203 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 249/486] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:05 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1756 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:06.027505 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-aa83b8f3-6111-40ee-863d-9d2727df9449 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:06.036128 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-aa83b8f3-6111-40ee-863d-9d2727df9449 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:06.037664 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-aa83b8f3-6111-40ee-863d-9d2727df9449 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:06.038856 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-aa83b8f3-6111-40ee-863d-9d2727df9449 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1810 microversion: 2.20 time: 0.197776 Aug 12 01:31:06.039467 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 238/487] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:31:05 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1810 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 01:31:06.128044 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-8fec7f32-c1bc-4c9a-a6c3-78ce48bf83b6 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:06.128754 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-8fec7f32-c1bc-4c9a-a6c3-78ce48bf83b6 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] [instance: ecabacb5-7e74-412d-990b-52e1181cba09] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:06.137705 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8fec7f32-c1bc-4c9a-a6c3-78ce48bf83b6 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:06.138329 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8fec7f32-c1bc-4c9a-a6c3-78ce48bf83b6 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:06.138807 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8fec7f32-c1bc-4c9a-a6c3-78ce48bf83b6 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:06.139786 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8fec7f32-c1bc-4c9a-a6c3-78ce48bf83b6 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:06.140354 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8fec7f32-c1bc-4c9a-a6c3-78ce48bf83b6 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:06.140911 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8fec7f32-c1bc-4c9a-a6c3-78ce48bf83b6 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:06.154323 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.wsgi [None req-8fec7f32-c1bc-4c9a-a6c3-78ce48bf83b6 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] HTTP exception thrown: Instance ecabacb5-7e74-412d-990b-52e1181cba09 could not be found. Aug 12 01:31:06.155980 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-8fec7f32-c1bc-4c9a-a6c3-78ce48bf83b6 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Request method failure captured: Aug 12 01:31:06.155980 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: request: GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09 HTTP/1.1 Aug 12 01:31:06.155980 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept: application/json Aug 12 01:31:06.155980 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept-Encoding: identity Aug 12 01:31:06.155980 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Connection: close Aug 12 01:31:06.155980 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Length: 0 Aug 12 01:31:06.155980 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Type: application/json Aug 12 01:31:06.155980 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Host: 10.222.0.20 Aug 12 01:31:06.155980 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Openstack-System-Scope: None Aug 12 01:31:06.155980 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: User-Agent: python-urllib3/1.26.11 Aug 12 01:31:06.155980 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Auth-Token: gAAAAABi9a0iOi0g6SJF3zz9Lk4dwOSX9ERVkzpyo0liYLKETjH2kjyqGhxBlp7pK4Ad6rzlakMfqOWSM0UWbQzFMxZBwIVumIgZPD2yYBJ4TthAF3Umx85AP0f3eIxCn2V4iiz_Wq1utRMdKX7SoZcIKGrsM3uOFkshiAdxYInvnujXg53uMLc Aug 12 01:31:06.155980 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Id: None Aug 12 01:31:06.155980 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Name: None Aug 12 01:31:06.155980 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Identity-Status: Confirmed Aug 12 01:31:06.155980 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Is-Admin-Project: True Aug 12 01:31:06.155980 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Id: default Aug 12 01:31:06.155980 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Name: Default Aug 12 01:31:06.155980 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Id: 2aa3549819204b219cbf52a1f9e004e9 Aug 12 01:31:06.155980 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Name: tempest-VolumesActionsTest-986704748 Aug 12 01:31:06.155980 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Role: member,reader Aug 12 01:31:06.155980 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Roles: member,reader Aug 12 01:31:06.157502 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2aa3549819204b219cbf52a1f9e004e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2aa3549819204b219cbf52a1f9e004e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2aa3549819204b219cbf52a1f9e004e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2aa3549819204b219cbf52a1f9e004e9"}]}] Aug 12 01:31:06.157502 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant: tempest-VolumesActionsTest-986704748 Aug 12 01:31:06.157502 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Id: 2aa3549819204b219cbf52a1f9e004e9 Aug 12 01:31:06.157502 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Name: tempest-VolumesActionsTest-986704748 Aug 12 01:31:06.157502 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User: tempest-VolumesActionsTest-986704748-project Aug 12 01:31:06.157502 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Id: default Aug 12 01:31:06.157502 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Name: Default Aug 12 01:31:06.157502 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Id: 1242495b42384050a1da78e89821dc77 Aug 12 01:31:06.157502 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Name: tempest-VolumesActionsTest-986704748-project Aug 12 01:31:06.157502 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: method: > Aug 12 01:31:06.157502 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: exception: Instance ecabacb5-7e74-412d-990b-52e1181cba09 could not be found. Aug 12 01:31:06.157502 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: action_args: {'id': 'ecabacb5-7e74-412d-990b-52e1181cba09'} Aug 12 01:31:06.158367 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:31:06.158367 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:31:06.158367 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:31:06.158367 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:31:06.158367 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:31:06.158367 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:31:06.158367 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:31:06.158367 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:31:06.158367 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:31:06.158367 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:31:06.158367 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecabacb5-7e74-412d-990b-52e1181cba09 could not be found. Aug 12 01:31:06.158367 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:31:06.158367 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:31:06.158367 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:31:06.158367 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:31:06.158367 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:31:06.158367 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:31:06.158367 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:31:06.158367 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:31:06.158367 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:31:06.159879 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:31:06.159879 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 01:31:06.159879 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 01:31:06.159879 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:31:06.159879 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:31:06.159879 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:31:06.159879 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:31:06.159879 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecabacb5-7e74-412d-990b-52e1181cba09 could not be found. Aug 12 01:31:06.159879 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:31:06.159879 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:31:06.159879 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:31:06.159879 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:31:06.159879 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:31:06.159879 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:31:06.159879 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:31:06.159879 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:31:06.159879 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecabacb5-7e74-412d-990b-52e1181cba09 could not be found. Aug 12 01:31:06.159879 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:31:06.161013 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-8fec7f32-c1bc-4c9a-a6c3-78ce48bf83b6 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] Returning 404 to user: Instance ecabacb5-7e74-412d-990b-52e1181cba09 could not be found. {{(pid=120786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:31:06.161013 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-8fec7f32-c1bc-4c9a-a6c3-78ce48bf83b6 tempest-VolumesActionsTest-986704748 tempest-VolumesActionsTest-986704748-project] 10.222.0.20 "GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09" status: 404 len: 111 microversion: 2.1 time: 0.035436 Aug 12 01:31:06.161013 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 250/488] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:06 2022] GET /compute/v2.1/servers/ecabacb5-7e74-412d-990b-52e1181cba09 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:31:06.451184 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-b481695d-b193-4987-a4fe-4236a1f51507 req-92270de1-6ac9-4f76-ae70-241483117b79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ed5ced2-87ad-4d0f-860c-648bcca91ca8", "name": "network-vif-plugged", "status": "completed", "tag": "476d0433-5310-435b-93ea-c42ed83c3136"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:31:06.460727 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-b481695d-b193-4987-a4fe-4236a1f51507 req-92270de1-6ac9-4f76-ae70-241483117b79 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:06.461199 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-b481695d-b193-4987-a4fe-4236a1f51507 req-92270de1-6ac9-4f76-ae70-241483117b79 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:06.461618 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-b481695d-b193-4987-a4fe-4236a1f51507 req-92270de1-6ac9-4f76-ae70-241483117b79 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:06.476766 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-b481695d-b193-4987-a4fe-4236a1f51507 req-92270de1-6ac9-4f76-ae70-241483117b79 service nova] Creating event network-vif-plugged:476d0433-5310-435b-93ea-c42ed83c3136 for instance 0ed5ced2-87ad-4d0f-860c-648bcca91ca8 on hv-cinder-78481 Aug 12 01:31:06.483337 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-b481695d-b193-4987-a4fe-4236a1f51507 req-92270de1-6ac9-4f76-ae70-241483117b79 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035779 Aug 12 01:31:06.484515 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 239/489] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:31:07.022555 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-77ea1731-21da-4ed9-bc57-918d8afa5c32 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:07.023083 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-77ea1731-21da-4ed9-bc57-918d8afa5c32 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:07.029721 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-77ea1731-21da-4ed9-bc57-918d8afa5c32 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:07.030219 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-77ea1731-21da-4ed9-bc57-918d8afa5c32 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:07.030653 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-77ea1731-21da-4ed9-bc57-918d8afa5c32 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:07.031387 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-77ea1731-21da-4ed9-bc57-918d8afa5c32 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:07.031862 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-77ea1731-21da-4ed9-bc57-918d8afa5c32 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:07.032286 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-77ea1731-21da-4ed9-bc57-918d8afa5c32 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:07.063392 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-e2fbd3f4-2459-469c-b6e9-f94aa22a3b2b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:07.064124 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-e2fbd3f4-2459-469c-b6e9-f94aa22a3b2b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:07.070590 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e2fbd3f4-2459-469c-b6e9-f94aa22a3b2b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:07.071072 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e2fbd3f4-2459-469c-b6e9-f94aa22a3b2b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:07.071505 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e2fbd3f4-2459-469c-b6e9-f94aa22a3b2b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:07.072230 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e2fbd3f4-2459-469c-b6e9-f94aa22a3b2b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:07.072674 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e2fbd3f4-2459-469c-b6e9-f94aa22a3b2b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:07.073095 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e2fbd3f4-2459-469c-b6e9-f94aa22a3b2b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:07.299287 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-77ea1731-21da-4ed9-bc57-918d8afa5c32 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:07.303356 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-e2fbd3f4-2459-469c-b6e9-f94aa22a3b2b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:07.308387 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-77ea1731-21da-4ed9-bc57-918d8afa5c32 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1756 microversion: 2.1 time: 0.289829 Aug 12 01:31:07.308990 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 251/490] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:07 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1756 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:31:07.312839 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-e2fbd3f4-2459-469c-b6e9-f94aa22a3b2b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:07.314373 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-e2fbd3f4-2459-469c-b6e9-f94aa22a3b2b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:07.315562 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-e2fbd3f4-2459-469c-b6e9-f94aa22a3b2b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1810 microversion: 2.20 time: 0.257432 Aug 12 01:31:07.316127 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 240/491] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:31:07 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1810 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:31:08.331571 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-50010708-c1d8-42ad-918f-356ac3680efb tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:08.332402 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-50010708-c1d8-42ad-918f-356ac3680efb tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:08.338734 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-76221738-a832-4b47-a56d-47034fca7ab4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:08.339353 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-76221738-a832-4b47-a56d-47034fca7ab4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:08.339793 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-50010708-c1d8-42ad-918f-356ac3680efb tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:08.340426 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-50010708-c1d8-42ad-918f-356ac3680efb tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:08.340852 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-50010708-c1d8-42ad-918f-356ac3680efb tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:08.341900 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-50010708-c1d8-42ad-918f-356ac3680efb tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:08.342376 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-50010708-c1d8-42ad-918f-356ac3680efb tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:08.343221 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-50010708-c1d8-42ad-918f-356ac3680efb tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:08.346693 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-76221738-a832-4b47-a56d-47034fca7ab4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:08.347166 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-76221738-a832-4b47-a56d-47034fca7ab4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:08.348042 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-76221738-a832-4b47-a56d-47034fca7ab4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:08.348870 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-76221738-a832-4b47-a56d-47034fca7ab4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:08.349338 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-76221738-a832-4b47-a56d-47034fca7ab4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:08.349773 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-76221738-a832-4b47-a56d-47034fca7ab4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:08.546014 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-76221738-a832-4b47-a56d-47034fca7ab4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:08.552231 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-50010708-c1d8-42ad-918f-356ac3680efb tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:08.554977 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-76221738-a832-4b47-a56d-47034fca7ab4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:08.556498 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-76221738-a832-4b47-a56d-47034fca7ab4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:08.557822 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-76221738-a832-4b47-a56d-47034fca7ab4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1810 microversion: 2.20 time: 0.223254 Aug 12 01:31:08.558381 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 241/492] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:31:08 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1810 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 01:31:08.561473 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-50010708-c1d8-42ad-918f-356ac3680efb tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1756 microversion: 2.1 time: 0.234319 Aug 12 01:31:08.562085 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 252/493] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:08 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1756 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:09.584640 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-febc012f-7e10-4758-ae9f-82a921b47c1a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:09.585521 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-febc012f-7e10-4758-ae9f-82a921b47c1a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:09.588509 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-b09722f6-1e9e-41e6-ac6a-a67c9192de24 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:09.589889 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-b09722f6-1e9e-41e6-ac6a-a67c9192de24 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:09.595154 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-febc012f-7e10-4758-ae9f-82a921b47c1a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:09.595651 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-febc012f-7e10-4758-ae9f-82a921b47c1a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:09.596076 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-febc012f-7e10-4758-ae9f-82a921b47c1a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:09.596754 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-febc012f-7e10-4758-ae9f-82a921b47c1a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:09.597192 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-febc012f-7e10-4758-ae9f-82a921b47c1a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:09.597604 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-febc012f-7e10-4758-ae9f-82a921b47c1a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:09.598263 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b09722f6-1e9e-41e6-ac6a-a67c9192de24 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:09.598760 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b09722f6-1e9e-41e6-ac6a-a67c9192de24 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:09.599190 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b09722f6-1e9e-41e6-ac6a-a67c9192de24 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:09.599925 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b09722f6-1e9e-41e6-ac6a-a67c9192de24 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:09.600360 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b09722f6-1e9e-41e6-ac6a-a67c9192de24 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:09.600783 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b09722f6-1e9e-41e6-ac6a-a67c9192de24 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:09.805336 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-febc012f-7e10-4758-ae9f-82a921b47c1a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:09.814231 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-febc012f-7e10-4758-ae9f-82a921b47c1a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:09.815843 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-febc012f-7e10-4758-ae9f-82a921b47c1a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:09.817187 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-febc012f-7e10-4758-ae9f-82a921b47c1a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1810 microversion: 2.20 time: 0.239226 Aug 12 01:31:09.817749 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 242/494] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:31:09 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1810 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:31:09.818996 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-b09722f6-1e9e-41e6-ac6a-a67c9192de24 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:09.827177 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-b09722f6-1e9e-41e6-ac6a-a67c9192de24 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1756 microversion: 2.1 time: 0.245048 Aug 12 01:31:09.827771 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 253/495] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:09 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1756 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:10.841463 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-fcb1ec87-4cfa-43e6-bf76-7adb1c3a812a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:10.842182 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-fcb1ec87-4cfa-43e6-bf76-7adb1c3a812a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:10.848969 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-9e075956-f462-4b21-a10a-5a1efb21f11a tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:10.849608 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-9e075956-f462-4b21-a10a-5a1efb21f11a tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:10.849745 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-fcb1ec87-4cfa-43e6-bf76-7adb1c3a812a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:10.850170 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-fcb1ec87-4cfa-43e6-bf76-7adb1c3a812a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:10.850599 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-fcb1ec87-4cfa-43e6-bf76-7adb1c3a812a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:10.851289 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-fcb1ec87-4cfa-43e6-bf76-7adb1c3a812a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:10.851763 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-fcb1ec87-4cfa-43e6-bf76-7adb1c3a812a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:10.852182 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-fcb1ec87-4cfa-43e6-bf76-7adb1c3a812a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:10.856168 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9e075956-f462-4b21-a10a-5a1efb21f11a tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:10.856648 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9e075956-f462-4b21-a10a-5a1efb21f11a tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:10.857075 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9e075956-f462-4b21-a10a-5a1efb21f11a tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:10.857768 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9e075956-f462-4b21-a10a-5a1efb21f11a tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:10.858213 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9e075956-f462-4b21-a10a-5a1efb21f11a tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:10.858627 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9e075956-f462-4b21-a10a-5a1efb21f11a tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:11.105136 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-fcb1ec87-4cfa-43e6-bf76-7adb1c3a812a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:11.113789 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-fcb1ec87-4cfa-43e6-bf76-7adb1c3a812a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:11.115278 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-fcb1ec87-4cfa-43e6-bf76-7adb1c3a812a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:11.116518 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-fcb1ec87-4cfa-43e6-bf76-7adb1c3a812a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1810 microversion: 2.20 time: 0.279932 Aug 12 01:31:11.117122 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 243/496] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:31:10 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1810 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:31:11.133249 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-9e075956-f462-4b21-a10a-5a1efb21f11a tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:11.141515 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-9e075956-f462-4b21-a10a-5a1efb21f11a tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1756 microversion: 2.1 time: 0.296388 Aug 12 01:31:11.142112 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 254/497] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:10 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1756 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:12.140131 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-4a9f4b81-b24b-4b4a-9f4f-1d613eea06f7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:12.140834 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-4a9f4b81-b24b-4b4a-9f4f-1d613eea06f7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:12.152245 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4a9f4b81-b24b-4b4a-9f4f-1d613eea06f7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:12.152994 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4a9f4b81-b24b-4b4a-9f4f-1d613eea06f7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:12.153460 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4a9f4b81-b24b-4b4a-9f4f-1d613eea06f7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:12.154697 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4a9f4b81-b24b-4b4a-9f4f-1d613eea06f7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:12.155292 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4a9f4b81-b24b-4b4a-9f4f-1d613eea06f7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:12.157917 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4a9f4b81-b24b-4b4a-9f4f-1d613eea06f7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:12.170218 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-6da37b35-6c59-4239-a843-37e367800c24 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:12.170861 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-6da37b35-6c59-4239-a843-37e367800c24 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:12.189208 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_api:SELECT=67 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:12.191010 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6da37b35-6c59-4239-a843-37e367800c24 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:12.191840 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6da37b35-6c59-4239-a843-37e367800c24 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:12.196182 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6da37b35-6c59-4239-a843-37e367800c24 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:12.196810 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6da37b35-6c59-4239-a843-37e367800c24 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:12.197275 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6da37b35-6c59-4239-a843-37e367800c24 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:12.198096 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6da37b35-6c59-4239-a843-37e367800c24 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:12.210637 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:12.482746 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-4a9f4b81-b24b-4b4a-9f4f-1d613eea06f7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:12.504290 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-4a9f4b81-b24b-4b4a-9f4f-1d613eea06f7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:12.505795 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-4a9f4b81-b24b-4b4a-9f4f-1d613eea06f7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:12.507824 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-4a9f4b81-b24b-4b4a-9f4f-1d613eea06f7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1810 microversion: 2.20 time: 0.373323 Aug 12 01:31:12.509216 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 244/498] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:31:12 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1810 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:31:12.541808 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-6da37b35-6c59-4239-a843-37e367800c24 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:12.561662 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-6da37b35-6c59-4239-a843-37e367800c24 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1756 microversion: 2.1 time: 0.402495 Aug 12 01:31:12.562302 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 255/499] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:12 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1756 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:13.536285 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-67d822d3-770b-44d0-b12d-24deb453135c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:13.537290 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-67d822d3-770b-44d0-b12d-24deb453135c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:13.545987 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-67d822d3-770b-44d0-b12d-24deb453135c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:13.547493 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-67d822d3-770b-44d0-b12d-24deb453135c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:13.548058 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-67d822d3-770b-44d0-b12d-24deb453135c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:13.548850 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-67d822d3-770b-44d0-b12d-24deb453135c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:13.549345 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-67d822d3-770b-44d0-b12d-24deb453135c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:13.549878 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-67d822d3-770b-44d0-b12d-24deb453135c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:13.590231 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-50886a27-14a5-4ef5-a138-9aabe9143300 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:13.591475 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-50886a27-14a5-4ef5-a138-9aabe9143300 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:13.601791 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-50886a27-14a5-4ef5-a138-9aabe9143300 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:13.602880 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-50886a27-14a5-4ef5-a138-9aabe9143300 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:13.603505 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-50886a27-14a5-4ef5-a138-9aabe9143300 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:13.605075 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-50886a27-14a5-4ef5-a138-9aabe9143300 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:13.605704 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-50886a27-14a5-4ef5-a138-9aabe9143300 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:13.606294 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-50886a27-14a5-4ef5-a138-9aabe9143300 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:13.742319 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-67d822d3-770b-44d0-b12d-24deb453135c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:13.754106 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-67d822d3-770b-44d0-b12d-24deb453135c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:13.755716 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-67d822d3-770b-44d0-b12d-24deb453135c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:13.756894 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-67d822d3-770b-44d0-b12d-24deb453135c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1797 microversion: 2.20 time: 0.227110 Aug 12 01:31:13.771978 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 245/500] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:31:13 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1797 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:31:13.791946 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-50886a27-14a5-4ef5-a138-9aabe9143300 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:13.801286 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-50886a27-14a5-4ef5-a138-9aabe9143300 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1756 microversion: 2.1 time: 0.214821 Aug 12 01:31:13.801966 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 256/501] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:13 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1756 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:31:14.823243 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-b85bdf15-9219-4486-bf54-0165c060efe6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:14.824595 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-b85bdf15-9219-4486-bf54-0165c060efe6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:14.831524 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b85bdf15-9219-4486-bf54-0165c060efe6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:14.832393 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b85bdf15-9219-4486-bf54-0165c060efe6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:14.833000 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b85bdf15-9219-4486-bf54-0165c060efe6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:14.833881 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b85bdf15-9219-4486-bf54-0165c060efe6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:14.834490 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b85bdf15-9219-4486-bf54-0165c060efe6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:14.835069 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b85bdf15-9219-4486-bf54-0165c060efe6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:14.987380 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-b85bdf15-9219-4486-bf54-0165c060efe6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:14.996780 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-b85bdf15-9219-4486-bf54-0165c060efe6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1756 microversion: 2.1 time: 0.177787 Aug 12 01:31:14.997489 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 246/502] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:14 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:16.019101 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-2e12de36-961c-4f75-b614-b2ccbdaada81 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:16.020416 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-2e12de36-961c-4f75-b614-b2ccbdaada81 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:16.027472 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2e12de36-961c-4f75-b614-b2ccbdaada81 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:16.027974 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2e12de36-961c-4f75-b614-b2ccbdaada81 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:16.028616 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2e12de36-961c-4f75-b614-b2ccbdaada81 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:16.029651 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2e12de36-961c-4f75-b614-b2ccbdaada81 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:16.030310 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2e12de36-961c-4f75-b614-b2ccbdaada81 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:16.030915 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2e12de36-961c-4f75-b614-b2ccbdaada81 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:16.190030 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-2e12de36-961c-4f75-b614-b2ccbdaada81 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:16.200052 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-2e12de36-961c-4f75-b614-b2ccbdaada81 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1756 microversion: 2.1 time: 0.185139 Aug 12 01:31:16.208181 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 257/503] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:16 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1756 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:17.229997 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-5d1fbae3-3d43-4bf3-b303-b75c15450df6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:17.229997 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-5d1fbae3-3d43-4bf3-b303-b75c15450df6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:17.235092 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:17.237064 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5d1fbae3-3d43-4bf3-b303-b75c15450df6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:17.237540 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5d1fbae3-3d43-4bf3-b303-b75c15450df6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:17.238051 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5d1fbae3-3d43-4bf3-b303-b75c15450df6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:17.238757 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5d1fbae3-3d43-4bf3-b303-b75c15450df6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:17.239220 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5d1fbae3-3d43-4bf3-b303-b75c15450df6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:17.239634 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5d1fbae3-3d43-4bf3-b303-b75c15450df6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:17.697038 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-5d1fbae3-3d43-4bf3-b303-b75c15450df6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:17.705582 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-5d1fbae3-3d43-4bf3-b303-b75c15450df6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1756 microversion: 2.1 time: 0.485092 Aug 12 01:31:17.706161 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 247/504] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:17 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1756 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:18.726523 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-16509d12-9e1d-4deb-9a2a-b09dc1da5ef5 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:18.728075 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-16509d12-9e1d-4deb-9a2a-b09dc1da5ef5 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:18.736112 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-16509d12-9e1d-4deb-9a2a-b09dc1da5ef5 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:18.736674 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-16509d12-9e1d-4deb-9a2a-b09dc1da5ef5 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:18.737114 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-16509d12-9e1d-4deb-9a2a-b09dc1da5ef5 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:18.737840 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-16509d12-9e1d-4deb-9a2a-b09dc1da5ef5 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:18.738287 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-16509d12-9e1d-4deb-9a2a-b09dc1da5ef5 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:18.738703 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-16509d12-9e1d-4deb-9a2a-b09dc1da5ef5 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:18.892591 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-16509d12-9e1d-4deb-9a2a-b09dc1da5ef5 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:18.902149 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-16509d12-9e1d-4deb-9a2a-b09dc1da5ef5 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1756 microversion: 2.1 time: 0.179679 Aug 12 01:31:18.902836 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 258/505] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:18 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:19.927696 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-918d7623-cc38-4512-bdaa-7b96c7f5feff tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:19.928348 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-918d7623-cc38-4512-bdaa-7b96c7f5feff tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:19.935580 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-918d7623-cc38-4512-bdaa-7b96c7f5feff tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:19.936091 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-918d7623-cc38-4512-bdaa-7b96c7f5feff tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:19.936522 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-918d7623-cc38-4512-bdaa-7b96c7f5feff tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:19.937400 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-918d7623-cc38-4512-bdaa-7b96c7f5feff tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:19.937852 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-918d7623-cc38-4512-bdaa-7b96c7f5feff tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:19.938259 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-918d7623-cc38-4512-bdaa-7b96c7f5feff tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:20.104020 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-918d7623-cc38-4512-bdaa-7b96c7f5feff tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:20.113194 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-918d7623-cc38-4512-bdaa-7b96c7f5feff tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1756 microversion: 2.1 time: 0.188406 Aug 12 01:31:20.118063 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 248/506] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:19 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1756 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:21.136898 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-dc07f667-a685-4041-b108-4b4d817e5262 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:21.137522 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-dc07f667-a685-4041-b108-4b4d817e5262 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:21.145062 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dc07f667-a685-4041-b108-4b4d817e5262 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:21.145463 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dc07f667-a685-4041-b108-4b4d817e5262 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:21.145897 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dc07f667-a685-4041-b108-4b4d817e5262 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:21.146632 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dc07f667-a685-4041-b108-4b4d817e5262 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:21.147079 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dc07f667-a685-4041-b108-4b4d817e5262 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:21.147498 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dc07f667-a685-4041-b108-4b4d817e5262 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:21.314256 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-dc07f667-a685-4041-b108-4b4d817e5262 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:21.327298 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-dc07f667-a685-4041-b108-4b4d817e5262 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1756 microversion: 2.1 time: 0.194641 Aug 12 01:31:21.330698 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 259/507] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:21 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1756 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:31:22.353648 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-b6b730b9-0508-427b-ac0e-646cf9a296e7 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:22.354489 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-b6b730b9-0508-427b-ac0e-646cf9a296e7 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:22.363499 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b6b730b9-0508-427b-ac0e-646cf9a296e7 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:22.364105 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b6b730b9-0508-427b-ac0e-646cf9a296e7 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:22.364653 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b6b730b9-0508-427b-ac0e-646cf9a296e7 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:22.365450 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b6b730b9-0508-427b-ac0e-646cf9a296e7 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:22.366065 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b6b730b9-0508-427b-ac0e-646cf9a296e7 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:22.366579 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b6b730b9-0508-427b-ac0e-646cf9a296e7 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:22.523484 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-b6b730b9-0508-427b-ac0e-646cf9a296e7 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:22.532332 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-b6b730b9-0508-427b-ac0e-646cf9a296e7 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1759 microversion: 2.1 time: 0.186005 Aug 12 01:31:22.533486 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 249/508] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:22 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1759 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:38.000407 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-ce69b0cf-c931-47b9-afc9-6e25dcbe4506 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:38.001185 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-ce69b0cf-c931-47b9-afc9-6e25dcbe4506 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 0835a143-9929-4018-99dc-2f3e3915fb43] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:38.003133 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_api:SELECT=9 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:38.003804 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell1:SELECT=62 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:38.009474 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ce69b0cf-c931-47b9-afc9-6e25dcbe4506 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:38.009944 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ce69b0cf-c931-47b9-afc9-6e25dcbe4506 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:38.010363 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ce69b0cf-c931-47b9-afc9-6e25dcbe4506 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:38.011043 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ce69b0cf-c931-47b9-afc9-6e25dcbe4506 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:38.011499 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ce69b0cf-c931-47b9-afc9-6e25dcbe4506 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:38.011919 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ce69b0cf-c931-47b9-afc9-6e25dcbe4506 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:38.035704 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-ce69b0cf-c931-47b9-afc9-6e25dcbe4506 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43/ips" status: 200 len: 150 microversion: 2.1 time: 0.041638 Aug 12 01:31:38.036259 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 260/509] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Aug 12 01:31:37 2022] GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:31:38.047925 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-4f93b6a7-f6a3-41bc-b371-b791861816a7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6108d5df-c35c-45a0-ab30-da331c855b78"}} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:31:38.050345 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-4f93b6a7-f6a3-41bc-b371-b791861816a7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 0835a143-9929-4018-99dc-2f3e3915fb43] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:38.052540 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_api:SELECT=5 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:38.053217 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell1:SELECT=32 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:38.058995 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4f93b6a7-f6a3-41bc-b371-b791861816a7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:38.059472 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4f93b6a7-f6a3-41bc-b371-b791861816a7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:38.059931 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4f93b6a7-f6a3-41bc-b371-b791861816a7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:38.060618 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4f93b6a7-f6a3-41bc-b371-b791861816a7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:38.061059 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4f93b6a7-f6a3-41bc-b371-b791861816a7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:38.061479 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4f93b6a7-f6a3-41bc-b371-b791861816a7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:38.143756 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.wsgi [None req-4f93b6a7-f6a3-41bc-b371-b791861816a7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] HTTP exception thrown: Invalid volume: volume 6108d5df-c35c-45a0-ab30-da331c855b78 is already attached to instances: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 Aug 12 01:31:38.146168 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-4f93b6a7-f6a3-41bc-b371-b791861816a7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Request method failure captured: Aug 12 01:31:38.146168 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: request: POST /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43/os-volume_attachments HTTP/1.1 Aug 12 01:31:38.146168 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept: application/json Aug 12 01:31:38.146168 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept-Encoding: identity Aug 12 01:31:38.146168 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Connection: close Aug 12 01:31:38.146168 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Length: 74 Aug 12 01:31:38.146168 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Type: application/json Aug 12 01:31:38.146168 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Host: 10.222.0.20 Aug 12 01:31:38.146168 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Openstack-System-Scope: None Aug 12 01:31:38.146168 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: User-Agent: python-urllib3/1.26.11 Aug 12 01:31:38.146168 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Auth-Token: gAAAAABi9aysta1ExUaxXxQ9rYnSUQP7esxJrZzjQTGP-Rx-1mSW3FSa4Ni1V3s1gY-bX9pmoxF8Imm85iSgEmyp6i7Om1zZCTrheGnqYhUdvsswrsrCeMS3azlEhIm0ZDa-UZ_XH6zsXrFWA97-e9Lhn4LyTV3IcnRq62-QuKU-oVMmx5EzFRU Aug 12 01:31:38.146168 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Id: None Aug 12 01:31:38.146168 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Name: None Aug 12 01:31:38.146168 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Identity-Status: Confirmed Aug 12 01:31:38.146168 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Is-Admin-Project: True Aug 12 01:31:38.146168 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Id: default Aug 12 01:31:38.146168 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Name: Default Aug 12 01:31:38.146168 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Id: e5e2fd72103c4b5e956ef5b9c291f16d Aug 12 01:31:38.146168 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:31:38.146168 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Role: member,reader Aug 12 01:31:38.146168 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Roles: member,reader Aug 12 01:31:38.147962 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e5e2fd72103c4b5e956ef5b9c291f16d"}]}] Aug 12 01:31:38.147962 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:31:38.147962 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Id: e5e2fd72103c4b5e956ef5b9c291f16d Aug 12 01:31:38.147962 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:31:38.147962 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User: tempest-AttachVolumeNegativeTest-2079581927-project Aug 12 01:31:38.147962 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Id: default Aug 12 01:31:38.147962 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Name: Default Aug 12 01:31:38.147962 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Id: 4395876e1de944ae82d23d43a30a82a8 Aug 12 01:31:38.147962 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Name: tempest-AttachVolumeNegativeTest-2079581927-project Aug 12 01:31:38.147962 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Aug 12 01:31:38.147962 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: {"volumeAttachment": {"volumeId": "6108d5df-c35c-45a0-ab30-da331c855b78"}} Aug 12 01:31:38.147962 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: method: > Aug 12 01:31:38.149371 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: exception: Invalid volume: volume 6108d5df-c35c-45a0-ab30-da331c855b78 is already attached to instances: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 Aug 12 01:31:38.149371 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: action_args: {'server_id': '0835a143-9929-4018-99dc-2f3e3915fb43', 'body': {'volumeAttachment': {'volumeId': '6108d5df-c35c-45a0-ab30-da331c855b78'}}} Aug 12 01:31:38.149371 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:31:38.149371 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:31:38.149371 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 12 01:31:38.149371 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 12 01:31:38.149371 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 12 01:31:38.149371 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 12 01:31:38.149371 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 12 01:31:38.149371 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 12 01:31:38.149371 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 12 01:31:38.149371 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 12 01:31:38.149371 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 12 01:31:38.149371 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 12 01:31:38.149371 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6108d5df-c35c-45a0-ab30-da331c855b78 is already attached to instances: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 Aug 12 01:31:38.149371 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:31:38.149371 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:31:38.149371 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:31:38.149371 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:31:38.151925 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:31:38.151925 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:31:38.151925 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:31:38.151925 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:31:38.151925 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:31:38.151925 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:31:38.151925 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 01:31:38.151925 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 01:31:38.151925 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 01:31:38.151925 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 01:31:38.151925 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 01:31:38.151925 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 01:31:38.151925 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 12 01:31:38.151925 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 12 01:31:38.151925 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6108d5df-c35c-45a0-ab30-da331c855b78 is already attached to instances: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 Aug 12 01:31:38.151925 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:31:38.151925 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:31:38.151925 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:31:38.151925 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:31:38.151925 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:31:38.154343 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:31:38.154343 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:31:38.154343 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:31:38.154343 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6108d5df-c35c-45a0-ab30-da331c855b78 is already attached to instances: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 Aug 12 01:31:38.154343 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:31:38.154343 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-4f93b6a7-f6a3-41bc-b371-b791861816a7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Returning 400 to user: Invalid volume: volume 6108d5df-c35c-45a0-ab30-da331c855b78 is already attached to instances: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 {{(pid=120785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:31:38.154343 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-4f93b6a7-f6a3-41bc-b371-b791861816a7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "POST /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104112 Aug 12 01:31:38.154343 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 250/510] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Aug 12 01:31:38 2022] POST /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 12 01:31:38.160178 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-32662d1d-3b38-448d-86a1-194f3845e4c2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:38.160678 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-32662d1d-3b38-448d-86a1-194f3845e4c2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 0835a143-9929-4018-99dc-2f3e3915fb43] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:38.167208 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-32662d1d-3b38-448d-86a1-194f3845e4c2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:38.167731 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-32662d1d-3b38-448d-86a1-194f3845e4c2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:38.168164 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-32662d1d-3b38-448d-86a1-194f3845e4c2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:38.168851 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-32662d1d-3b38-448d-86a1-194f3845e4c2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:38.169299 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-32662d1d-3b38-448d-86a1-194f3845e4c2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:38.169722 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-32662d1d-3b38-448d-86a1-194f3845e4c2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:38.196448 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-32662d1d-3b38-448d-86a1-194f3845e4c2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 0835a143-9929-4018-99dc-2f3e3915fb43] Going to try to terminate instance {{(pid=120786) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 01:31:38.286376 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-32662d1d-3b38-448d-86a1-194f3845e4c2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43" status: 204 len: 0 microversion: 2.1 time: 0.130330 Aug 12 01:31:38.287292 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 261/511] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 01:31:38 2022] DELETE /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 01:31:38.295366 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-3e2255b4-9051-4a36-9d15-bcc3f20195cb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:38.296110 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-3e2255b4-9051-4a36-9d15-bcc3f20195cb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 0835a143-9929-4018-99dc-2f3e3915fb43] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:38.302055 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3e2255b4-9051-4a36-9d15-bcc3f20195cb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:38.302531 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3e2255b4-9051-4a36-9d15-bcc3f20195cb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:38.302959 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3e2255b4-9051-4a36-9d15-bcc3f20195cb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:38.303666 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3e2255b4-9051-4a36-9d15-bcc3f20195cb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:38.304423 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3e2255b4-9051-4a36-9d15-bcc3f20195cb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:38.304849 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3e2255b4-9051-4a36-9d15-bcc3f20195cb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:38.439887 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-3e2255b4-9051-4a36-9d15-bcc3f20195cb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:38.447800 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-3e2255b4-9051-4a36-9d15-bcc3f20195cb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43" status: 200 len: 1682 microversion: 2.1 time: 0.156405 Aug 12 01:31:38.448360 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 251/512] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:38 2022] GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:39.470203 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-063fc3e9-3a9a-4420-9bde-18e86e981031 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:39.470893 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-063fc3e9-3a9a-4420-9bde-18e86e981031 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 0835a143-9929-4018-99dc-2f3e3915fb43] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:39.478064 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-063fc3e9-3a9a-4420-9bde-18e86e981031 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:39.478541 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-063fc3e9-3a9a-4420-9bde-18e86e981031 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:39.479000 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-063fc3e9-3a9a-4420-9bde-18e86e981031 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:39.479731 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-063fc3e9-3a9a-4420-9bde-18e86e981031 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:39.480181 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-063fc3e9-3a9a-4420-9bde-18e86e981031 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:39.480599 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-063fc3e9-3a9a-4420-9bde-18e86e981031 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:39.619046 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-063fc3e9-3a9a-4420-9bde-18e86e981031 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:39.627579 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-063fc3e9-3a9a-4420-9bde-18e86e981031 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43" status: 200 len: 1682 microversion: 2.1 time: 0.161864 Aug 12 01:31:39.628242 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 262/513] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:39 2022] GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:40.649103 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-7b1f5fba-0146-4bfe-8b11-efb43d287c53 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:40.649709 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-7b1f5fba-0146-4bfe-8b11-efb43d287c53 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 0835a143-9929-4018-99dc-2f3e3915fb43] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:40.656688 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7b1f5fba-0146-4bfe-8b11-efb43d287c53 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:40.657175 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7b1f5fba-0146-4bfe-8b11-efb43d287c53 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:40.657611 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7b1f5fba-0146-4bfe-8b11-efb43d287c53 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:40.658306 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7b1f5fba-0146-4bfe-8b11-efb43d287c53 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:40.658757 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7b1f5fba-0146-4bfe-8b11-efb43d287c53 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:40.659183 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7b1f5fba-0146-4bfe-8b11-efb43d287c53 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:40.737315 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-53d8f7b3-ee15-498e-bb6d-e50be0c43bf9 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a46cfd6-f449-4868-930e-d4cd2356ce0c"}} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:31:40.739930 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-53d8f7b3-ee15-498e-bb6d-e50be0c43bf9 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:40.748445 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-53d8f7b3-ee15-498e-bb6d-e50be0c43bf9 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:40.749006 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-53d8f7b3-ee15-498e-bb6d-e50be0c43bf9 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:40.749505 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-53d8f7b3-ee15-498e-bb6d-e50be0c43bf9 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:40.750266 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-53d8f7b3-ee15-498e-bb6d-e50be0c43bf9 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:40.750801 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-53d8f7b3-ee15-498e-bb6d-e50be0c43bf9 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:40.751283 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-53d8f7b3-ee15-498e-bb6d-e50be0c43bf9 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:40.857967 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-7b1f5fba-0146-4bfe-8b11-efb43d287c53 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:40.872077 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-7b1f5fba-0146-4bfe-8b11-efb43d287c53 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43" status: 200 len: 1682 microversion: 2.1 time: 0.220736 Aug 12 01:31:40.873916 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 252/514] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:40 2022] GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43 => generated 1682 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:41.020601 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-53d8f7b3-ee15-498e-bb6d-e50be0c43bf9 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "POST /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287331 Aug 12 01:31:41.021403 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 263/515] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Aug 12 01:31:40 2022] POST /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:31:41.252679 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-99791b2c-cc85-4dbc-a808-98ba71aef20b req-e89122b1-bce8-43ff-af6b-854796bf581c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0835a143-9929-4018-99dc-2f3e3915fb43", "name": "network-vif-deleted", "tag": "68c71044-03ca-436d-a9ff-d049d4286d64"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:31:41.262891 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-99791b2c-cc85-4dbc-a808-98ba71aef20b req-e89122b1-bce8-43ff-af6b-854796bf581c service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:41.263357 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-99791b2c-cc85-4dbc-a808-98ba71aef20b req-e89122b1-bce8-43ff-af6b-854796bf581c service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:41.263804 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-99791b2c-cc85-4dbc-a808-98ba71aef20b req-e89122b1-bce8-43ff-af6b-854796bf581c service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:41.275255 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-99791b2c-cc85-4dbc-a808-98ba71aef20b req-e89122b1-bce8-43ff-af6b-854796bf581c service nova] Creating event network-vif-deleted:68c71044-03ca-436d-a9ff-d049d4286d64 for instance 0835a143-9929-4018-99dc-2f3e3915fb43 on hv-cinder-78481 Aug 12 01:31:41.281241 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-99791b2c-cc85-4dbc-a808-98ba71aef20b req-e89122b1-bce8-43ff-af6b-854796bf581c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032146 Aug 12 01:31:41.283893 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 253/516] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:31:41.895645 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-a21d0b96-5130-4c89-a486-ce3c4eb15f5d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:41.896416 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-a21d0b96-5130-4c89-a486-ce3c4eb15f5d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 0835a143-9929-4018-99dc-2f3e3915fb43] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:41.903216 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a21d0b96-5130-4c89-a486-ce3c4eb15f5d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:41.903739 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a21d0b96-5130-4c89-a486-ce3c4eb15f5d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:41.904184 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a21d0b96-5130-4c89-a486-ce3c4eb15f5d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:41.904892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a21d0b96-5130-4c89-a486-ce3c4eb15f5d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:41.905533 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a21d0b96-5130-4c89-a486-ce3c4eb15f5d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:41.906022 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a21d0b96-5130-4c89-a486-ce3c4eb15f5d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:41.920799 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.wsgi [None req-a21d0b96-5130-4c89-a486-ce3c4eb15f5d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] HTTP exception thrown: Instance 0835a143-9929-4018-99dc-2f3e3915fb43 could not be found. Aug 12 01:31:41.922532 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-a21d0b96-5130-4c89-a486-ce3c4eb15f5d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Request method failure captured: Aug 12 01:31:41.922532 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: request: GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43 HTTP/1.1 Aug 12 01:31:41.922532 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept: application/json Aug 12 01:31:41.922532 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept-Encoding: identity Aug 12 01:31:41.922532 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Connection: close Aug 12 01:31:41.922532 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Length: 0 Aug 12 01:31:41.922532 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Type: application/json Aug 12 01:31:41.922532 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Host: 10.222.0.20 Aug 12 01:31:41.922532 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Openstack-System-Scope: None Aug 12 01:31:41.922532 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: User-Agent: python-urllib3/1.26.11 Aug 12 01:31:41.922532 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Auth-Token: gAAAAABi9aysta1ExUaxXxQ9rYnSUQP7esxJrZzjQTGP-Rx-1mSW3FSa4Ni1V3s1gY-bX9pmoxF8Imm85iSgEmyp6i7Om1zZCTrheGnqYhUdvsswrsrCeMS3azlEhIm0ZDa-UZ_XH6zsXrFWA97-e9Lhn4LyTV3IcnRq62-QuKU-oVMmx5EzFRU Aug 12 01:31:41.922532 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Id: None Aug 12 01:31:41.922532 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Name: None Aug 12 01:31:41.922532 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Identity-Status: Confirmed Aug 12 01:31:41.922532 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Is-Admin-Project: True Aug 12 01:31:41.922532 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Id: default Aug 12 01:31:41.922532 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Name: Default Aug 12 01:31:41.922532 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Id: e5e2fd72103c4b5e956ef5b9c291f16d Aug 12 01:31:41.922532 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:31:41.922532 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Role: member,reader Aug 12 01:31:41.922532 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Roles: member,reader Aug 12 01:31:41.924057 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e5e2fd72103c4b5e956ef5b9c291f16d"}]}] Aug 12 01:31:41.924057 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:31:41.924057 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Id: e5e2fd72103c4b5e956ef5b9c291f16d Aug 12 01:31:41.924057 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:31:41.924057 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User: tempest-AttachVolumeNegativeTest-2079581927-project Aug 12 01:31:41.924057 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Id: default Aug 12 01:31:41.924057 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Name: Default Aug 12 01:31:41.924057 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Id: 4395876e1de944ae82d23d43a30a82a8 Aug 12 01:31:41.924057 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Name: tempest-AttachVolumeNegativeTest-2079581927-project Aug 12 01:31:41.924057 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: method: > Aug 12 01:31:41.924057 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: exception: Instance 0835a143-9929-4018-99dc-2f3e3915fb43 could not be found. Aug 12 01:31:41.924057 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: action_args: {'id': '0835a143-9929-4018-99dc-2f3e3915fb43'} Aug 12 01:31:41.924855 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:31:41.924855 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:31:41.924855 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:31:41.924855 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:31:41.924855 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:31:41.924855 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:31:41.924855 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:31:41.924855 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:31:41.924855 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:31:41.924855 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:31:41.924855 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0835a143-9929-4018-99dc-2f3e3915fb43 could not be found. Aug 12 01:31:41.924855 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:31:41.924855 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:31:41.924855 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:31:41.924855 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:31:41.924855 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:31:41.924855 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:31:41.924855 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:31:41.924855 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:31:41.924855 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:31:41.926240 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:31:41.926240 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 01:31:41.926240 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 01:31:41.926240 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:31:41.926240 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:31:41.926240 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:31:41.926240 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:31:41.926240 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0835a143-9929-4018-99dc-2f3e3915fb43 could not be found. Aug 12 01:31:41.926240 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:31:41.926240 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:31:41.926240 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:31:41.926240 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:31:41.926240 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:31:41.926240 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:31:41.926240 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:31:41.926240 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:31:41.926240 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0835a143-9929-4018-99dc-2f3e3915fb43 could not be found. Aug 12 01:31:41.926240 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:31:41.927473 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-a21d0b96-5130-4c89-a486-ce3c4eb15f5d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Returning 404 to user: Instance 0835a143-9929-4018-99dc-2f3e3915fb43 could not be found. {{(pid=120786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:31:41.927473 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-a21d0b96-5130-4c89-a486-ce3c4eb15f5d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43" status: 404 len: 111 microversion: 2.1 time: 0.033244 Aug 12 01:31:41.934076 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-77ea1521-2847-446d-be45-adddd1e71a59 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '.version_select at 0x7f2decedcaf0>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:41.938299 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 264/517] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:41 2022] GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:31:41.954437 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-77ea1521-2847-446d-be45-adddd1e71a59 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1521877628" status: 202 len: 0 microversion: 2.1 time: 0.025161 Aug 12 01:31:41.954970 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 254/518] 10.222.0.20 () {58 vars in 1221 bytes} [Fri Aug 12 01:31:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1521877628 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 01:31:42.718626 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-e81740b6-163a-4551-946d-146e025a9d1f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:42.719056 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-e81740b6-163a-4551-946d-146e025a9d1f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:42.725856 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e81740b6-163a-4551-946d-146e025a9d1f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:42.726448 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e81740b6-163a-4551-946d-146e025a9d1f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:42.726904 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e81740b6-163a-4551-946d-146e025a9d1f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:42.727972 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e81740b6-163a-4551-946d-146e025a9d1f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:42.728418 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e81740b6-163a-4551-946d-146e025a9d1f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:42.728826 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e81740b6-163a-4551-946d-146e025a9d1f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:42.859888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.objects.instance [None req-e81740b6-163a-4551-946d-146e025a9d1f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lazy-loading 'services' on Instance uuid da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 {{(pid=120786) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 01:31:42.976062 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-e81740b6-163a-4551-946d-146e025a9d1f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "DELETE /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9/os-volume_attachments/6108d5df-c35c-45a0-ab30-da331c855b78" status: 202 len: 0 microversion: 2.1 time: 0.260680 Aug 12 01:31:42.976644 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 265/519] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Aug 12 01:31:42 2022] DELETE /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9/os-volume_attachments/6108d5df-c35c-45a0-ab30-da331c855b78 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 01:31:42.987514 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-c0c3bffb-fd26-43cb-9fdd-309fb68b0191 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:42.989797 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-c0c3bffb-fd26-43cb-9fdd-309fb68b0191 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:42.996582 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c0c3bffb-fd26-43cb-9fdd-309fb68b0191 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:42.997050 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c0c3bffb-fd26-43cb-9fdd-309fb68b0191 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:42.997466 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c0c3bffb-fd26-43cb-9fdd-309fb68b0191 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:42.998366 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c0c3bffb-fd26-43cb-9fdd-309fb68b0191 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:42.999031 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c0c3bffb-fd26-43cb-9fdd-309fb68b0191 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:42.999467 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c0c3bffb-fd26-43cb-9fdd-309fb68b0191 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:43.032794 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-c0c3bffb-fd26-43cb-9fdd-309fb68b0191 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050136 Aug 12 01:31:43.033398 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 255/520] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 01:31:42 2022] GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:31:43.667779 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-707053e7-285c-4cf2-a1ce-e21a0d5324c3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:43.668719 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-707053e7-285c-4cf2-a1ce-e21a0d5324c3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:43.676986 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-707053e7-285c-4cf2-a1ce-e21a0d5324c3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:43.677457 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-707053e7-285c-4cf2-a1ce-e21a0d5324c3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:43.677883 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-707053e7-285c-4cf2-a1ce-e21a0d5324c3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:43.678560 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-707053e7-285c-4cf2-a1ce-e21a0d5324c3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:43.679004 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-707053e7-285c-4cf2-a1ce-e21a0d5324c3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:43.679759 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-707053e7-285c-4cf2-a1ce-e21a0d5324c3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:43.767240 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.objects.instance [None req-707053e7-285c-4cf2-a1ce-e21a0d5324c3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lazy-loading 'services' on Instance uuid c4364ac0-a9b7-4650-8456-15ccdd39bc3a {{(pid=120786) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 01:31:43.846651 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-707053e7-285c-4cf2-a1ce-e21a0d5324c3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a/os-volume_attachments/fa1b74e5-b091-49cd-908f-97799cef23b0" status: 202 len: 0 microversion: 2.1 time: 0.186920 Aug 12 01:31:43.847397 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 266/521] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Aug 12 01:31:43 2022] DELETE /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a/os-volume_attachments/fa1b74e5-b091-49cd-908f-97799cef23b0 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 01:31:44.044926 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-aa727d33-82b8-4234-add9-975e893f1e7e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:44.047170 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-aa727d33-82b8-4234-add9-975e893f1e7e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:44.054492 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-aa727d33-82b8-4234-add9-975e893f1e7e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:44.054971 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-aa727d33-82b8-4234-add9-975e893f1e7e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:44.055408 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-aa727d33-82b8-4234-add9-975e893f1e7e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:44.056156 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-aa727d33-82b8-4234-add9-975e893f1e7e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:44.056604 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-aa727d33-82b8-4234-add9-975e893f1e7e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:44.057029 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-aa727d33-82b8-4234-add9-975e893f1e7e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:44.086723 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-aa727d33-82b8-4234-add9-975e893f1e7e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045809 Aug 12 01:31:44.087214 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 256/522] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 01:31:44 2022] GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:31:45.104299 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-2b6ef545-3097-438a-9ecf-e7e1a67f324b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:45.108171 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-2b6ef545-3097-438a-9ecf-e7e1a67f324b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:45.115038 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2b6ef545-3097-438a-9ecf-e7e1a67f324b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:45.115520 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2b6ef545-3097-438a-9ecf-e7e1a67f324b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:45.115984 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2b6ef545-3097-438a-9ecf-e7e1a67f324b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:45.116707 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2b6ef545-3097-438a-9ecf-e7e1a67f324b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:45.117151 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2b6ef545-3097-438a-9ecf-e7e1a67f324b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:45.117542 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2b6ef545-3097-438a-9ecf-e7e1a67f324b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:45.149491 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-2b6ef545-3097-438a-9ecf-e7e1a67f324b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053197 Aug 12 01:31:45.150056 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 267/523] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 01:31:45 2022] GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:31:46.166110 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-c8f03999-203f-470f-8dae-f5d2a43e4464 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:46.169662 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-c8f03999-203f-470f-8dae-f5d2a43e4464 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:46.180794 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c8f03999-203f-470f-8dae-f5d2a43e4464 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:46.181570 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c8f03999-203f-470f-8dae-f5d2a43e4464 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:46.182273 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c8f03999-203f-470f-8dae-f5d2a43e4464 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:46.183385 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c8f03999-203f-470f-8dae-f5d2a43e4464 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:46.184168 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c8f03999-203f-470f-8dae-f5d2a43e4464 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:46.184852 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c8f03999-203f-470f-8dae-f5d2a43e4464 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:46.216470 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-c8f03999-203f-470f-8dae-f5d2a43e4464 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057060 Aug 12 01:31:46.217016 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 257/524] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 01:31:46 2022] GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:31:47.232403 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-99dd744a-c233-4e14-b004-c95de4a5248f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:47.235212 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-99dd744a-c233-4e14-b004-c95de4a5248f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:47.242136 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-99dd744a-c233-4e14-b004-c95de4a5248f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:47.242614 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-99dd744a-c233-4e14-b004-c95de4a5248f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:47.243044 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-99dd744a-c233-4e14-b004-c95de4a5248f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:47.243764 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-99dd744a-c233-4e14-b004-c95de4a5248f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:47.244207 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-99dd744a-c233-4e14-b004-c95de4a5248f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:47.244624 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-99dd744a-c233-4e14-b004-c95de4a5248f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:47.273603 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-99dd744a-c233-4e14-b004-c95de4a5248f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048084 Aug 12 01:31:47.274149 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 268/525] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 01:31:47 2022] GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:31:48.289806 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-ae97eb68-144c-4bd9-bbe2-02da1b5d8b69 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:48.293316 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-ae97eb68-144c-4bd9-bbe2-02da1b5d8b69 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:48.301382 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ae97eb68-144c-4bd9-bbe2-02da1b5d8b69 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:48.301857 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ae97eb68-144c-4bd9-bbe2-02da1b5d8b69 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:48.302281 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ae97eb68-144c-4bd9-bbe2-02da1b5d8b69 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:48.302959 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ae97eb68-144c-4bd9-bbe2-02da1b5d8b69 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:48.303397 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ae97eb68-144c-4bd9-bbe2-02da1b5d8b69 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:48.303846 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ae97eb68-144c-4bd9-bbe2-02da1b5d8b69 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:48.338755 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-ae97eb68-144c-4bd9-bbe2-02da1b5d8b69 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055441 Aug 12 01:31:48.339334 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 258/526] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 01:31:48 2022] GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:31:48.611083 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-7c27ac75-70c3-483d-a41a-4366cfcaa4d7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:31:48.613401 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-7c27ac75-70c3-483d-a41a-4366cfcaa4d7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:48.620306 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7c27ac75-70c3-483d-a41a-4366cfcaa4d7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:48.620750 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7c27ac75-70c3-483d-a41a-4366cfcaa4d7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:48.621356 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7c27ac75-70c3-483d-a41a-4366cfcaa4d7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:48.622168 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7c27ac75-70c3-483d-a41a-4366cfcaa4d7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:48.622950 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7c27ac75-70c3-483d-a41a-4366cfcaa4d7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:48.623679 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7c27ac75-70c3-483d-a41a-4366cfcaa4d7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:48.648743 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.objects.instance [None req-7c27ac75-70c3-483d-a41a-4366cfcaa4d7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lazy-loading 'flavor' on Instance uuid f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a {{(pid=120786) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 01:31:48.811697 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-7c27ac75-70c3-483d-a41a-4366cfcaa4d7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "POST /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a/action" status: 200 len: 32 microversion: 2.1 time: 0.204519 Aug 12 01:31:48.812263 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 269/527] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Aug 12 01:31:48 2022] POST /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a/action => generated 32 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 01:31:48.821682 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-3619039b-9b9b-43c9-826e-d93f32159d9c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:48.822286 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-3619039b-9b9b-43c9-826e-d93f32159d9c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:48.828357 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3619039b-9b9b-43c9-826e-d93f32159d9c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:48.828836 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3619039b-9b9b-43c9-826e-d93f32159d9c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:48.829268 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3619039b-9b9b-43c9-826e-d93f32159d9c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:48.829943 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3619039b-9b9b-43c9-826e-d93f32159d9c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:48.830421 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3619039b-9b9b-43c9-826e-d93f32159d9c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:48.830836 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3619039b-9b9b-43c9-826e-d93f32159d9c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:48.965581 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-3619039b-9b9b-43c9-826e-d93f32159d9c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:48.973951 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-3619039b-9b9b-43c9-826e-d93f32159d9c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1733 microversion: 2.1 time: 0.156081 Aug 12 01:31:48.974515 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 259/528] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:48 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:49.351734 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-f5d7cf9c-b599-4c7e-8956-e33097ba2b8e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:49.358030 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-f5d7cf9c-b599-4c7e-8956-e33097ba2b8e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:49.364466 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f5d7cf9c-b599-4c7e-8956-e33097ba2b8e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:49.364944 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f5d7cf9c-b599-4c7e-8956-e33097ba2b8e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:49.365425 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f5d7cf9c-b599-4c7e-8956-e33097ba2b8e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:49.366127 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f5d7cf9c-b599-4c7e-8956-e33097ba2b8e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:49.366566 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f5d7cf9c-b599-4c7e-8956-e33097ba2b8e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:49.366981 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f5d7cf9c-b599-4c7e-8956-e33097ba2b8e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:49.397795 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-f5d7cf9c-b599-4c7e-8956-e33097ba2b8e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050879 Aug 12 01:31:49.398650 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 270/529] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 01:31:49 2022] GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 01:31:49.461629 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-bdc2bf91-5968-456b-8aee-773cf81d2080 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:49.462207 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-bdc2bf91-5968-456b-8aee-773cf81d2080 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:49.468364 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bdc2bf91-5968-456b-8aee-773cf81d2080 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:49.468842 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bdc2bf91-5968-456b-8aee-773cf81d2080 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:49.469278 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bdc2bf91-5968-456b-8aee-773cf81d2080 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:49.469969 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bdc2bf91-5968-456b-8aee-773cf81d2080 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:49.470401 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bdc2bf91-5968-456b-8aee-773cf81d2080 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:49.470821 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bdc2bf91-5968-456b-8aee-773cf81d2080 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:49.496105 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-bdc2bf91-5968-456b-8aee-773cf81d2080 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9] Going to try to terminate instance {{(pid=120785) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 01:31:49.580373 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-bdc2bf91-5968-456b-8aee-773cf81d2080 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "DELETE /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9" status: 204 len: 0 microversion: 2.1 time: 0.122228 Aug 12 01:31:49.581148 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 260/530] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 01:31:49 2022] DELETE /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 01:31:49.589258 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-3b69ce6f-dc64-455d-bce0-d043ef5f8ced tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:49.589872 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-3b69ce6f-dc64-455d-bce0-d043ef5f8ced tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:49.596315 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3b69ce6f-dc64-455d-bce0-d043ef5f8ced tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:49.597023 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3b69ce6f-dc64-455d-bce0-d043ef5f8ced tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:49.597459 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3b69ce6f-dc64-455d-bce0-d043ef5f8ced tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:49.598707 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3b69ce6f-dc64-455d-bce0-d043ef5f8ced tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:49.598707 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3b69ce6f-dc64-455d-bce0-d043ef5f8ced tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:49.599087 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3b69ce6f-dc64-455d-bce0-d043ef5f8ced tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:49.603729 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=5,nova_cell1:INSERT=5 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:49.729608 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-3b69ce6f-dc64-455d-bce0-d043ef5f8ced tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:49.737558 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-3b69ce6f-dc64-455d-bce0-d043ef5f8ced tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9" status: 200 len: 1683 microversion: 2.1 time: 0.152188 Aug 12 01:31:49.738146 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 271/531] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:49 2022] GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:31:50.000312 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-31fbeaf9-f716-4c30-bc1a-aae924447cb7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:50.001022 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-31fbeaf9-f716-4c30-bc1a-aae924447cb7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:50.008433 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-31fbeaf9-f716-4c30-bc1a-aae924447cb7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:50.008994 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-31fbeaf9-f716-4c30-bc1a-aae924447cb7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:50.009532 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-31fbeaf9-f716-4c30-bc1a-aae924447cb7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:50.010325 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-31fbeaf9-f716-4c30-bc1a-aae924447cb7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:50.010841 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-31fbeaf9-f716-4c30-bc1a-aae924447cb7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:50.011330 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-31fbeaf9-f716-4c30-bc1a-aae924447cb7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:50.154832 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-31fbeaf9-f716-4c30-bc1a-aae924447cb7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:50.163232 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-31fbeaf9-f716-4c30-bc1a-aae924447cb7 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1733 microversion: 2.1 time: 0.169884 Aug 12 01:31:50.163845 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 261/532] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:49 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1733 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:50.285084 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-a4b89ea9-89a9-4f66-9131-494ce4056672 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:31:50.291761 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a4b89ea9-89a9-4f66-9131-494ce4056672 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:50.292248 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a4b89ea9-89a9-4f66-9131-494ce4056672 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:50.292688 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a4b89ea9-89a9-4f66-9131-494ce4056672 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:50.354687 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-a4b89ea9-89a9-4f66-9131-494ce4056672 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Going to try to stop instance {{(pid=120786) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 12 01:31:50.401360 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-a4b89ea9-89a9-4f66-9131-494ce4056672 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "POST /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a/action" status: 202 len: 0 microversion: 2.1 time: 0.120008 Aug 12 01:31:50.401966 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 272/533] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Aug 12 01:31:50 2022] POST /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 01:31:50.413900 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-929d8d5d-1f63-4d93-aad7-6c6532054fb7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:50.414770 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-929d8d5d-1f63-4d93-aad7-6c6532054fb7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:50.422554 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-929d8d5d-1f63-4d93-aad7-6c6532054fb7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:50.423037 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-929d8d5d-1f63-4d93-aad7-6c6532054fb7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:50.423489 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-929d8d5d-1f63-4d93-aad7-6c6532054fb7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:50.424201 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-929d8d5d-1f63-4d93-aad7-6c6532054fb7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:50.424654 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-929d8d5d-1f63-4d93-aad7-6c6532054fb7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:50.425076 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-929d8d5d-1f63-4d93-aad7-6c6532054fb7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:50.566440 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-929d8d5d-1f63-4d93-aad7-6c6532054fb7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:50.574767 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-929d8d5d-1f63-4d93-aad7-6c6532054fb7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1721 microversion: 2.1 time: 0.166666 Aug 12 01:31:50.575339 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 262/534] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:50 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:50.765105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-6657399e-b196-4ce8-b2e8-3c302c5a0af5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:50.766173 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-6657399e-b196-4ce8-b2e8-3c302c5a0af5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:50.777017 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6657399e-b196-4ce8-b2e8-3c302c5a0af5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:50.777797 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6657399e-b196-4ce8-b2e8-3c302c5a0af5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:50.778564 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6657399e-b196-4ce8-b2e8-3c302c5a0af5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:50.779786 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6657399e-b196-4ce8-b2e8-3c302c5a0af5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:50.780524 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6657399e-b196-4ce8-b2e8-3c302c5a0af5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:50.781105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6657399e-b196-4ce8-b2e8-3c302c5a0af5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:50.930029 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-6657399e-b196-4ce8-b2e8-3c302c5a0af5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:50.943091 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-6657399e-b196-4ce8-b2e8-3c302c5a0af5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9" status: 200 len: 1683 microversion: 2.1 time: 0.185184 Aug 12 01:31:50.944751 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 273/535] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:50 2022] GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 => generated 1683 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:51.188587 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-b7b3a805-c700-42d7-9d71-4c8d365ed7ec tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:51.189559 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-b7b3a805-c700-42d7-9d71-4c8d365ed7ec tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:51.199622 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b7b3a805-c700-42d7-9d71-4c8d365ed7ec tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:51.200401 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b7b3a805-c700-42d7-9d71-4c8d365ed7ec tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:51.201110 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b7b3a805-c700-42d7-9d71-4c8d365ed7ec tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:51.202235 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b7b3a805-c700-42d7-9d71-4c8d365ed7ec tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:51.202879 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b7b3a805-c700-42d7-9d71-4c8d365ed7ec tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:51.203326 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b7b3a805-c700-42d7-9d71-4c8d365ed7ec tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:51.352488 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-b7b3a805-c700-42d7-9d71-4c8d365ed7ec tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:51.361077 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-b7b3a805-c700-42d7-9d71-4c8d365ed7ec tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1733 microversion: 2.1 time: 0.178890 Aug 12 01:31:51.361623 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 263/536] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:51 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1733 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:51.595388 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-9936fbc9-f1c7-4492-80d4-886f5fb189e2 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:51.596023 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-9936fbc9-f1c7-4492-80d4-886f5fb189e2 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:51.602305 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9936fbc9-f1c7-4492-80d4-886f5fb189e2 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:51.602776 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9936fbc9-f1c7-4492-80d4-886f5fb189e2 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:51.603202 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9936fbc9-f1c7-4492-80d4-886f5fb189e2 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:51.603923 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9936fbc9-f1c7-4492-80d4-886f5fb189e2 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:51.604365 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9936fbc9-f1c7-4492-80d4-886f5fb189e2 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:51.604808 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9936fbc9-f1c7-4492-80d4-886f5fb189e2 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:51.841754 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-9936fbc9-f1c7-4492-80d4-886f5fb189e2 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:51.849607 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-9936fbc9-f1c7-4492-80d4-886f5fb189e2 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1675 microversion: 2.1 time: 0.258220 Aug 12 01:31:51.850368 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 274/537] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:51 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1675 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:51.969673 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-3cfe2409-17ba-4346-976c-9f1beb731c43 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:51.970279 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-3cfe2409-17ba-4346-976c-9f1beb731c43 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:51.977157 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3cfe2409-17ba-4346-976c-9f1beb731c43 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:51.977572 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3cfe2409-17ba-4346-976c-9f1beb731c43 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:51.978001 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3cfe2409-17ba-4346-976c-9f1beb731c43 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:51.978691 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3cfe2409-17ba-4346-976c-9f1beb731c43 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:51.979134 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3cfe2409-17ba-4346-976c-9f1beb731c43 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:51.979556 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3cfe2409-17ba-4346-976c-9f1beb731c43 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:52.172034 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-3cfe2409-17ba-4346-976c-9f1beb731c43 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:52.180843 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-3cfe2409-17ba-4346-976c-9f1beb731c43 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9" status: 200 len: 1683 microversion: 2.1 time: 0.215843 Aug 12 01:31:52.181445 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 264/538] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:51 2022] GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 => generated 1683 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:52.382414 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-1814b9cd-f469-44d6-bfd7-f2203b406bf3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:52.383022 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-1814b9cd-f469-44d6-bfd7-f2203b406bf3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:52.389413 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1814b9cd-f469-44d6-bfd7-f2203b406bf3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:52.389930 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1814b9cd-f469-44d6-bfd7-f2203b406bf3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:52.390400 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1814b9cd-f469-44d6-bfd7-f2203b406bf3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:52.391087 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1814b9cd-f469-44d6-bfd7-f2203b406bf3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:52.391552 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1814b9cd-f469-44d6-bfd7-f2203b406bf3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:52.391982 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1814b9cd-f469-44d6-bfd7-f2203b406bf3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:52.503381 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-f0efacd9-32dd-4d72-a676-5a27720be7fb req-f081f95d-b361-46cb-a30f-db8d19144228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da106e4a-1bc6-4e68-ac0c-1a2ca899daa9", "name": "network-vif-deleted", "tag": "941dd4d7-4c16-4fb4-aa93-79972bef7581"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:31:52.514291 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-f0efacd9-32dd-4d72-a676-5a27720be7fb req-f081f95d-b361-46cb-a30f-db8d19144228 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:52.515173 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-f0efacd9-32dd-4d72-a676-5a27720be7fb req-f081f95d-b361-46cb-a30f-db8d19144228 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:52.515977 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-f0efacd9-32dd-4d72-a676-5a27720be7fb req-f081f95d-b361-46cb-a30f-db8d19144228 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:52.535223 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-f0efacd9-32dd-4d72-a676-5a27720be7fb req-f081f95d-b361-46cb-a30f-db8d19144228 service nova] Creating event network-vif-deleted:941dd4d7-4c16-4fb4-aa93-79972bef7581 for instance da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 on hv-cinder-78481 Aug 12 01:31:52.540394 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-f0efacd9-32dd-4d72-a676-5a27720be7fb req-f081f95d-b361-46cb-a30f-db8d19144228 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042179 Aug 12 01:31:52.541443 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 265/539] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:31:52.584733 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-1814b9cd-f469-44d6-bfd7-f2203b406bf3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:52.593244 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-1814b9cd-f469-44d6-bfd7-f2203b406bf3 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1733 microversion: 2.1 time: 0.214615 Aug 12 01:31:52.593827 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 275/540] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:52 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1733 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:31:52.870962 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-512c4cd7-9e0b-495d-b623-ff8fe9693d19 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:52.871713 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-512c4cd7-9e0b-495d-b623-ff8fe9693d19 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:52.878254 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-512c4cd7-9e0b-495d-b623-ff8fe9693d19 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:52.878736 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-512c4cd7-9e0b-495d-b623-ff8fe9693d19 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:52.879156 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-512c4cd7-9e0b-495d-b623-ff8fe9693d19 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:52.879868 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-512c4cd7-9e0b-495d-b623-ff8fe9693d19 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:52.880309 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-512c4cd7-9e0b-495d-b623-ff8fe9693d19 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:52.880718 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-512c4cd7-9e0b-495d-b623-ff8fe9693d19 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:53.021141 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-512c4cd7-9e0b-495d-b623-ff8fe9693d19 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:53.038652 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-512c4cd7-9e0b-495d-b623-ff8fe9693d19 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1675 microversion: 2.1 time: 0.171789 Aug 12 01:31:53.039700 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 266/541] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:52 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1675 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:53.202322 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-2fdab90c-e514-42da-a84f-5688675c470d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:53.203206 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-2fdab90c-e514-42da-a84f-5688675c470d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:53.209900 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2fdab90c-e514-42da-a84f-5688675c470d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:53.210407 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2fdab90c-e514-42da-a84f-5688675c470d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:53.210832 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2fdab90c-e514-42da-a84f-5688675c470d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:53.211503 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2fdab90c-e514-42da-a84f-5688675c470d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:53.211969 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2fdab90c-e514-42da-a84f-5688675c470d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:53.212400 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2fdab90c-e514-42da-a84f-5688675c470d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:53.226542 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.wsgi [None req-2fdab90c-e514-42da-a84f-5688675c470d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] HTTP exception thrown: Instance da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 could not be found. Aug 12 01:31:53.228204 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-2fdab90c-e514-42da-a84f-5688675c470d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Request method failure captured: Aug 12 01:31:53.228204 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: request: GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 HTTP/1.1 Aug 12 01:31:53.228204 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept: application/json Aug 12 01:31:53.228204 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept-Encoding: identity Aug 12 01:31:53.228204 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Connection: close Aug 12 01:31:53.228204 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Length: 0 Aug 12 01:31:53.228204 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Type: application/json Aug 12 01:31:53.228204 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Host: 10.222.0.20 Aug 12 01:31:53.228204 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Openstack-System-Scope: None Aug 12 01:31:53.228204 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: User-Agent: python-urllib3/1.26.11 Aug 12 01:31:53.228204 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Auth-Token: gAAAAABi9aysta1ExUaxXxQ9rYnSUQP7esxJrZzjQTGP-Rx-1mSW3FSa4Ni1V3s1gY-bX9pmoxF8Imm85iSgEmyp6i7Om1zZCTrheGnqYhUdvsswrsrCeMS3azlEhIm0ZDa-UZ_XH6zsXrFWA97-e9Lhn4LyTV3IcnRq62-QuKU-oVMmx5EzFRU Aug 12 01:31:53.228204 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Id: None Aug 12 01:31:53.228204 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Name: None Aug 12 01:31:53.228204 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Identity-Status: Confirmed Aug 12 01:31:53.228204 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Is-Admin-Project: True Aug 12 01:31:53.228204 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Id: default Aug 12 01:31:53.228204 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Name: Default Aug 12 01:31:53.228204 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Id: e5e2fd72103c4b5e956ef5b9c291f16d Aug 12 01:31:53.228204 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:31:53.228204 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Role: member,reader Aug 12 01:31:53.228204 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Roles: member,reader Aug 12 01:31:53.229823 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e5e2fd72103c4b5e956ef5b9c291f16d"}]}] Aug 12 01:31:53.229823 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:31:53.229823 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Id: e5e2fd72103c4b5e956ef5b9c291f16d Aug 12 01:31:53.229823 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:31:53.229823 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User: tempest-AttachVolumeNegativeTest-2079581927-project Aug 12 01:31:53.229823 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Id: default Aug 12 01:31:53.229823 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Name: Default Aug 12 01:31:53.229823 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Id: 4395876e1de944ae82d23d43a30a82a8 Aug 12 01:31:53.229823 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Name: tempest-AttachVolumeNegativeTest-2079581927-project Aug 12 01:31:53.229823 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: method: > Aug 12 01:31:53.229823 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: exception: Instance da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 could not be found. Aug 12 01:31:53.229823 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: action_args: {'id': 'da106e4a-1bc6-4e68-ac0c-1a2ca899daa9'} Aug 12 01:31:53.230667 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:31:53.230667 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:31:53.230667 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:31:53.230667 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:31:53.230667 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:31:53.230667 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:31:53.230667 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:31:53.230667 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:31:53.230667 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:31:53.230667 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:31:53.230667 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 could not be found. Aug 12 01:31:53.230667 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:31:53.230667 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:31:53.230667 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:31:53.230667 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:31:53.230667 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:31:53.230667 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:31:53.230667 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:31:53.230667 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:31:53.230667 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:31:53.232112 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:31:53.232112 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 01:31:53.232112 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 01:31:53.232112 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:31:53.232112 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:31:53.232112 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:31:53.232112 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:31:53.232112 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 could not be found. Aug 12 01:31:53.232112 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:31:53.232112 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:31:53.232112 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:31:53.232112 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:31:53.232112 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:31:53.232112 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:31:53.232112 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:31:53.232112 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:31:53.232112 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 could not be found. Aug 12 01:31:53.232112 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:31:53.233353 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-2fdab90c-e514-42da-a84f-5688675c470d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Returning 404 to user: Instance da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 could not be found. {{(pid=120786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:31:53.233353 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-2fdab90c-e514-42da-a84f-5688675c470d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9" status: 404 len: 111 microversion: 2.1 time: 0.031213 Aug 12 01:31:53.233353 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 276/542] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:53 2022] GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:31:53.238384 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-830cbcc5-3d8a-4ac9-97c8-736849aeb58b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '.version_select at 0x7f2decf09670>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:53.257459 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-830cbcc5-3d8a-4ac9-97c8-736849aeb58b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-903954503" status: 202 len: 0 microversion: 2.1 time: 0.022763 Aug 12 01:31:53.258135 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 267/543] 10.222.0.20 () {58 vars in 1218 bytes} [Fri Aug 12 01:31:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-903954503 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 01:31:53.615676 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-d25c805c-7caa-4aa1-ab1a-79c40d90ea57 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:53.616278 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-d25c805c-7caa-4aa1-ab1a-79c40d90ea57 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:53.624540 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d25c805c-7caa-4aa1-ab1a-79c40d90ea57 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:53.625019 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d25c805c-7caa-4aa1-ab1a-79c40d90ea57 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:53.625446 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d25c805c-7caa-4aa1-ab1a-79c40d90ea57 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:53.626162 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d25c805c-7caa-4aa1-ab1a-79c40d90ea57 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:53.626635 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d25c805c-7caa-4aa1-ab1a-79c40d90ea57 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:53.627047 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d25c805c-7caa-4aa1-ab1a-79c40d90ea57 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:54.060673 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-de9c51a2-dd59-44df-8da2-6d57fea368cd tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:54.061158 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-d25c805c-7caa-4aa1-ab1a-79c40d90ea57 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:54.061392 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-de9c51a2-dd59-44df-8da2-6d57fea368cd tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:54.067564 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-de9c51a2-dd59-44df-8da2-6d57fea368cd tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:54.068074 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-de9c51a2-dd59-44df-8da2-6d57fea368cd tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:54.068505 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-de9c51a2-dd59-44df-8da2-6d57fea368cd tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:54.069178 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-de9c51a2-dd59-44df-8da2-6d57fea368cd tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:54.069438 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-d25c805c-7caa-4aa1-ab1a-79c40d90ea57 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1733 microversion: 2.1 time: 0.458292 Aug 12 01:31:54.069619 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-de9c51a2-dd59-44df-8da2-6d57fea368cd tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:54.069991 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 277/544] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:53 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1733 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:54.083345 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-de9c51a2-dd59-44df-8da2-6d57fea368cd tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:54.088722 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:54.292770 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-de9c51a2-dd59-44df-8da2-6d57fea368cd tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:54.295084 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-a34ef1a0-ba49-4a2e-ae49-cbd4fc8964bb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Action: 'create', calling method: .version_select at 0x7f2ded18a940>, body: {"keypair": {"name": "tempest-keypair-1352366985", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHe/0BHiUZnYvqrdqLPyfCm01VBM8q4MEgErPeMyREUx9bRSCHJQT2VvyxlXQmDaa6QcghQvpKg4Fr88QCrMJ3yqOXFUO7NlOclgZI8tX9cfUAsxTPCXNhFZ0njz0s9cdg=="}} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:31:54.300680 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-de9c51a2-dd59-44df-8da2-6d57fea368cd tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1675 microversion: 2.1 time: 0.244397 Aug 12 01:31:54.301242 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 268/545] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:54 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1675 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:54.312523 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.quota [None req-a34ef1a0-ba49-4a2e-ae49-cbd4fc8964bb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Getting quotas for project e5e2fd72103c4b5e956ef5b9c291f16d. Resources: {'key_pairs'} {{(pid=120786) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 01:31:54.316454 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.quota [None req-a34ef1a0-ba49-4a2e-ae49-cbd4fc8964bb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Getting quotas for user 4395876e1de944ae82d23d43a30a82a8 and project e5e2fd72103c4b5e956ef5b9c291f16d. Resources: {'key_pairs'} {{(pid=120786) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 01:31:54.340537 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-a34ef1a0-ba49-4a2e-ae49-cbd4fc8964bb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049485 Aug 12 01:31:54.341136 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 278/546] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Aug 12 01:31:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:31:55.091061 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-ef2384ba-063c-432d-a427-c2dbd2ba436c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:55.091822 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-ef2384ba-063c-432d-a427-c2dbd2ba436c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:55.098482 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ef2384ba-063c-432d-a427-c2dbd2ba436c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:55.098968 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ef2384ba-063c-432d-a427-c2dbd2ba436c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:55.099589 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ef2384ba-063c-432d-a427-c2dbd2ba436c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:55.100160 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ef2384ba-063c-432d-a427-c2dbd2ba436c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:55.100644 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ef2384ba-063c-432d-a427-c2dbd2ba436c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:55.101150 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ef2384ba-063c-432d-a427-c2dbd2ba436c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:55.235393 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-ef2384ba-063c-432d-a427-c2dbd2ba436c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:55.244268 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-ef2384ba-063c-432d-a427-c2dbd2ba436c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1733 microversion: 2.1 time: 0.157181 Aug 12 01:31:55.244931 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 269/547] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:55 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:55.322982 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-49ead649-a642-4c07-98a8-6ee2b4d6efd3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:55.323771 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-49ead649-a642-4c07-98a8-6ee2b4d6efd3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:55.333249 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-49ead649-a642-4c07-98a8-6ee2b4d6efd3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:55.333874 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-49ead649-a642-4c07-98a8-6ee2b4d6efd3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:55.334267 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-49ead649-a642-4c07-98a8-6ee2b4d6efd3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:55.334982 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-49ead649-a642-4c07-98a8-6ee2b4d6efd3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:55.335436 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-49ead649-a642-4c07-98a8-6ee2b4d6efd3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:55.335916 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-49ead649-a642-4c07-98a8-6ee2b4d6efd3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:55.466578 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-49ead649-a642-4c07-98a8-6ee2b4d6efd3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:55.474321 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-49ead649-a642-4c07-98a8-6ee2b4d6efd3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1675 microversion: 2.1 time: 0.155796 Aug 12 01:31:55.474893 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 279/548] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:55 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:55.645570 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-0542eab8-2c96-4581-98f0-6546139e48a0 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-412649163", "imageRef": "0d77ae04-91a5-4e2b-8817-72986618c549", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c69785c6-9bf5-4740-9585-57c14141c241"}], "security_groups": [{"name": "tempest-securitygroup--605639044"}], "key_name": "tempest-keypair-1352366985", "user_data": "}} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:31:55.753036 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.network.neutron [None req-0542eab8-2c96-4581-98f0-6546139e48a0 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] validate_networks() for [('c69785c6-9bf5-4740-9585-57c14141c241', None, None, None, None, None)] {{(pid=120785) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 01:31:56.132371 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-0542eab8-2c96-4581-98f0-6546139e48a0 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Flavor limits 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 01:31:56.132984 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-0542eab8-2c96-4581-98f0-6546139e48a0 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Image limits 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 01:31:56.133392 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-0542eab8-2c96-4581-98f0-6546139e48a0 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Flavor pref 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 01:31:56.133852 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-0542eab8-2c96-4581-98f0-6546139e48a0 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Image pref 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 01:31:56.134297 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-0542eab8-2c96-4581-98f0-6546139e48a0 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 01:31:56.144013 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0542eab8-2c96-4581-98f0-6546139e48a0 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:56.144488 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0542eab8-2c96-4581-98f0-6546139e48a0 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:56.144920 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0542eab8-2c96-4581-98f0-6546139e48a0 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:56.145647 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0542eab8-2c96-4581-98f0-6546139e48a0 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:56.146136 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0542eab8-2c96-4581-98f0-6546139e48a0 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:56.146559 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0542eab8-2c96-4581-98f0-6546139e48a0 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:56.164027 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.quota [None req-0542eab8-2c96-4581-98f0-6546139e48a0 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Getting quotas for project e5e2fd72103c4b5e956ef5b9c291f16d. Resources: {'cores', 'ram', 'instances'} {{(pid=120785) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 01:31:56.168639 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.quota [None req-0542eab8-2c96-4581-98f0-6546139e48a0 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Getting quotas for user 4395876e1de944ae82d23d43a30a82a8 and project e5e2fd72103c4b5e956ef5b9c291f16d. Resources: {'cores', 'ram', 'instances'} {{(pid=120785) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 01:31:56.180853 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-0542eab8-2c96-4581-98f0-6546139e48a0 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Going to run 1 instances... {{(pid=120785) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 01:31:56.183052 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-0542eab8-2c96-4581-98f0-6546139e48a0 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 033d7c0c-b5ff-43bb-995d-500a2c087f7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d77ae04-91a5-4e2b-8817-72986618c549',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120785) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 01:31:56.233602 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-0542eab8-2c96-4581-98f0-6546139e48a0 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.592346 Aug 12 01:31:56.234268 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 270/549] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 01:31:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 01:31:56.245047 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-2d578244-9965-4635-876e-01298e71d474 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:56.245640 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-2d578244-9965-4635-876e-01298e71d474 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 033d7c0c-b5ff-43bb-995d-500a2c087f7d] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:56.266317 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-683f3a5d-3554-43c9-b326-493040dd956b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:56.266935 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-683f3a5d-3554-43c9-b326-493040dd956b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:56.273927 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-683f3a5d-3554-43c9-b326-493040dd956b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:56.274452 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-683f3a5d-3554-43c9-b326-493040dd956b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:56.274893 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-683f3a5d-3554-43c9-b326-493040dd956b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:56.275608 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-683f3a5d-3554-43c9-b326-493040dd956b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:56.276225 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-683f3a5d-3554-43c9-b326-493040dd956b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:56.276805 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-683f3a5d-3554-43c9-b326-493040dd956b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:56.310413 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-2d578244-9965-4635-876e-01298e71d474 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:56.318065 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-2d578244-9965-4635-876e-01298e71d474 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d" status: 200 len: 1241 microversion: 2.1 time: 0.076807 Aug 12 01:31:56.318893 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 280/550] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:56 2022] GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d => generated 1241 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:56.425119 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-683f3a5d-3554-43c9-b326-493040dd956b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:56.433757 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-683f3a5d-3554-43c9-b326-493040dd956b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1733 microversion: 2.1 time: 0.171460 Aug 12 01:31:56.434227 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 271/551] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:56 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1733 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:56.494707 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-2c920bb1-4dde-44d0-844b-6e461059b517 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:56.495357 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-2c920bb1-4dde-44d0-844b-6e461059b517 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:56.501917 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2c920bb1-4dde-44d0-844b-6e461059b517 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:56.502385 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2c920bb1-4dde-44d0-844b-6e461059b517 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:56.502814 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2c920bb1-4dde-44d0-844b-6e461059b517 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:56.503489 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2c920bb1-4dde-44d0-844b-6e461059b517 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:56.503954 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2c920bb1-4dde-44d0-844b-6e461059b517 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:56.504363 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2c920bb1-4dde-44d0-844b-6e461059b517 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:56.642620 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-2c920bb1-4dde-44d0-844b-6e461059b517 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:56.650865 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-2c920bb1-4dde-44d0-844b-6e461059b517 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1675 microversion: 2.1 time: 0.160018 Aug 12 01:31:56.651433 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 281/552] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:56 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:57.339327 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-cc83234a-5607-4d93-a0ef-bdc97f5877c2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:57.340609 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-cc83234a-5607-4d93-a0ef-bdc97f5877c2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 033d7c0c-b5ff-43bb-995d-500a2c087f7d] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:57.350355 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cc83234a-5607-4d93-a0ef-bdc97f5877c2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:57.351224 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cc83234a-5607-4d93-a0ef-bdc97f5877c2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:57.351951 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cc83234a-5607-4d93-a0ef-bdc97f5877c2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:57.352883 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cc83234a-5607-4d93-a0ef-bdc97f5877c2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:57.353569 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cc83234a-5607-4d93-a0ef-bdc97f5877c2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:57.355014 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cc83234a-5607-4d93-a0ef-bdc97f5877c2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:57.429276 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-cc83234a-5607-4d93-a0ef-bdc97f5877c2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:57.436820 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-cc83234a-5607-4d93-a0ef-bdc97f5877c2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d" status: 200 len: 1299 microversion: 2.1 time: 0.101398 Aug 12 01:31:57.437379 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 272/553] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:57 2022] GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d => generated 1299 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:57.454431 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-1c34be6e-5fe0-4bde-9a9b-be8714d5a5ba tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:57.455061 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-1c34be6e-5fe0-4bde-9a9b-be8714d5a5ba tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:57.461223 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1c34be6e-5fe0-4bde-9a9b-be8714d5a5ba tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:57.461696 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1c34be6e-5fe0-4bde-9a9b-be8714d5a5ba tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:57.462145 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1c34be6e-5fe0-4bde-9a9b-be8714d5a5ba tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:57.462813 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1c34be6e-5fe0-4bde-9a9b-be8714d5a5ba tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:57.463254 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1c34be6e-5fe0-4bde-9a9b-be8714d5a5ba tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:57.463697 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1c34be6e-5fe0-4bde-9a9b-be8714d5a5ba tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:57.671175 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-1c34be6e-5fe0-4bde-9a9b-be8714d5a5ba tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:57.674960 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-53ed52f4-500f-4089-844b-fe340daa603d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:57.675621 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-53ed52f4-500f-4089-844b-fe340daa603d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:57.680157 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-1c34be6e-5fe0-4bde-9a9b-be8714d5a5ba tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1733 microversion: 2.1 time: 0.229567 Aug 12 01:31:57.680741 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 282/554] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:57 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1733 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:57.682436 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-53ed52f4-500f-4089-844b-fe340daa603d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:57.683117 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-53ed52f4-500f-4089-844b-fe340daa603d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:57.684329 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-53ed52f4-500f-4089-844b-fe340daa603d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:57.685895 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-53ed52f4-500f-4089-844b-fe340daa603d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:57.686489 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-53ed52f4-500f-4089-844b-fe340daa603d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:57.687055 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-53ed52f4-500f-4089-844b-fe340daa603d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:57.885262 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-53ed52f4-500f-4089-844b-fe340daa603d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:57.893220 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-53ed52f4-500f-4089-844b-fe340daa603d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1675 microversion: 2.1 time: 0.222187 Aug 12 01:31:57.893792 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 273/555] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:57 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1675 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:58.458310 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-ae7fa245-9e35-4979-a5c3-243679e74133 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:58.458923 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-ae7fa245-9e35-4979-a5c3-243679e74133 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 033d7c0c-b5ff-43bb-995d-500a2c087f7d] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:58.465156 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ae7fa245-9e35-4979-a5c3-243679e74133 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:58.465646 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ae7fa245-9e35-4979-a5c3-243679e74133 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:58.466080 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ae7fa245-9e35-4979-a5c3-243679e74133 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:58.466776 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ae7fa245-9e35-4979-a5c3-243679e74133 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:58.467228 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ae7fa245-9e35-4979-a5c3-243679e74133 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:58.467758 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ae7fa245-9e35-4979-a5c3-243679e74133 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:58.702005 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-a1dd1441-0c6f-4185-9e96-93594d28d99d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:58.702773 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-a1dd1441-0c6f-4185-9e96-93594d28d99d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:58.710845 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-ae7fa245-9e35-4979-a5c3-243679e74133 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:58.712183 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a1dd1441-0c6f-4185-9e96-93594d28d99d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:58.712861 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a1dd1441-0c6f-4185-9e96-93594d28d99d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:58.713462 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a1dd1441-0c6f-4185-9e96-93594d28d99d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:58.714320 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a1dd1441-0c6f-4185-9e96-93594d28d99d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:58.715055 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a1dd1441-0c6f-4185-9e96-93594d28d99d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:58.715872 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a1dd1441-0c6f-4185-9e96-93594d28d99d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:58.718958 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-ae7fa245-9e35-4979-a5c3-243679e74133 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d" status: 200 len: 1366 microversion: 2.1 time: 0.264786 Aug 12 01:31:58.719891 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 283/556] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:58 2022] GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:58.912211 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-7a27c36e-3349-447b-b1c9-c5e8b77c779d req-df8d5455-c1dd-4eae-8163-d877139ed970 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "033d7c0c-b5ff-43bb-995d-500a2c087f7d", "tag": "ce8f5755-06ab-4852-bd78-2e3e7aaea221"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:31:58.924042 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-7a27c36e-3349-447b-b1c9-c5e8b77c779d req-df8d5455-c1dd-4eae-8163-d877139ed970 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:58.924662 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-7a27c36e-3349-447b-b1c9-c5e8b77c779d req-df8d5455-c1dd-4eae-8163-d877139ed970 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:58.925128 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-7a27c36e-3349-447b-b1c9-c5e8b77c779d req-df8d5455-c1dd-4eae-8163-d877139ed970 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:58.930231 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-a1dd1441-0c6f-4185-9e96-93594d28d99d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:58.937406 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-7a27c36e-3349-447b-b1c9-c5e8b77c779d req-df8d5455-c1dd-4eae-8163-d877139ed970 service nova] Creating event network-changed:ce8f5755-06ab-4852-bd78-2e3e7aaea221 for instance 033d7c0c-b5ff-43bb-995d-500a2c087f7d on hv-cinder-78481 Aug 12 01:31:58.938936 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-a1dd1441-0c6f-4185-9e96-93594d28d99d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1733 microversion: 2.1 time: 0.241001 Aug 12 01:31:58.951599 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 274/557] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:58 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1733 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:58.951599 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-55a82a46-d957-4e18-94bd-773d176a2ef9 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:58.951599 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-55a82a46-d957-4e18-94bd-773d176a2ef9 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:58.952474 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-55a82a46-d957-4e18-94bd-773d176a2ef9 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:58.953260 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-55a82a46-d957-4e18-94bd-773d176a2ef9 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:58.953824 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-7a27c36e-3349-447b-b1c9-c5e8b77c779d req-df8d5455-c1dd-4eae-8163-d877139ed970 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045261 Aug 12 01:31:58.954332 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-55a82a46-d957-4e18-94bd-773d176a2ef9 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:58.954770 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 284/558] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:31:58.955521 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-55a82a46-d957-4e18-94bd-773d176a2ef9 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:58.956064 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-55a82a46-d957-4e18-94bd-773d176a2ef9 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:58.956559 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-55a82a46-d957-4e18-94bd-773d176a2ef9 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:59.150897 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-55a82a46-d957-4e18-94bd-773d176a2ef9 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:59.158947 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-55a82a46-d957-4e18-94bd-773d176a2ef9 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1675 microversion: 2.1 time: 0.217947 Aug 12 01:31:59.159554 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 275/559] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:58 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1675 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:59.741504 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-298353a0-9882-4f02-91ce-03b775b3eefb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:59.742269 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-298353a0-9882-4f02-91ce-03b775b3eefb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 033d7c0c-b5ff-43bb-995d-500a2c087f7d] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:59.749807 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-298353a0-9882-4f02-91ce-03b775b3eefb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:59.750286 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-298353a0-9882-4f02-91ce-03b775b3eefb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:59.750711 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-298353a0-9882-4f02-91ce-03b775b3eefb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:59.751418 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-298353a0-9882-4f02-91ce-03b775b3eefb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:59.751862 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-298353a0-9882-4f02-91ce-03b775b3eefb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:59.752307 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-298353a0-9882-4f02-91ce-03b775b3eefb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:59.893799 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-298353a0-9882-4f02-91ce-03b775b3eefb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:31:59.901279 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-298353a0-9882-4f02-91ce-03b775b3eefb tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d" status: 200 len: 1366 microversion: 2.1 time: 0.164456 Aug 12 01:31:59.901812 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 285/560] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:59 2022] GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:31:59.966279 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-9583ed51-c3ae-4649-8788-f39eadd23752 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:31:59.967229 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-9583ed51-c3ae-4649-8788-f39eadd23752 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:31:59.978203 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9583ed51-c3ae-4649-8788-f39eadd23752 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:59.979009 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9583ed51-c3ae-4649-8788-f39eadd23752 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:59.979779 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9583ed51-c3ae-4649-8788-f39eadd23752 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:31:59.980919 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9583ed51-c3ae-4649-8788-f39eadd23752 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:31:59.981741 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9583ed51-c3ae-4649-8788-f39eadd23752 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:31:59.982445 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9583ed51-c3ae-4649-8788-f39eadd23752 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:00.117200 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-9583ed51-c3ae-4649-8788-f39eadd23752 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:00.129402 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-9583ed51-c3ae-4649-8788-f39eadd23752 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1733 microversion: 2.1 time: 0.169376 Aug 12 01:32:00.130106 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 276/561] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:31:59 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1733 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:32:00.180694 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-cae25c0a-9dd4-488d-90f3-cc9bc50dae5c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:00.181321 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-cae25c0a-9dd4-488d-90f3-cc9bc50dae5c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:00.187577 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cae25c0a-9dd4-488d-90f3-cc9bc50dae5c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:00.188056 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cae25c0a-9dd4-488d-90f3-cc9bc50dae5c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:00.188483 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cae25c0a-9dd4-488d-90f3-cc9bc50dae5c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:00.189159 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cae25c0a-9dd4-488d-90f3-cc9bc50dae5c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:00.189602 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cae25c0a-9dd4-488d-90f3-cc9bc50dae5c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:00.190013 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cae25c0a-9dd4-488d-90f3-cc9bc50dae5c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:00.320806 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-cae25c0a-9dd4-488d-90f3-cc9bc50dae5c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:00.328562 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-cae25c0a-9dd4-488d-90f3-cc9bc50dae5c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1675 microversion: 2.1 time: 0.152009 Aug 12 01:32:00.329147 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 286/562] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:00 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:32:00.921522 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-bdbe5a5a-5a8b-42cb-9522-d284095f6c0d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:00.922148 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-bdbe5a5a-5a8b-42cb-9522-d284095f6c0d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 033d7c0c-b5ff-43bb-995d-500a2c087f7d] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:00.928437 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bdbe5a5a-5a8b-42cb-9522-d284095f6c0d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:00.929229 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bdbe5a5a-5a8b-42cb-9522-d284095f6c0d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:00.929665 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bdbe5a5a-5a8b-42cb-9522-d284095f6c0d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:00.930339 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bdbe5a5a-5a8b-42cb-9522-d284095f6c0d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:00.930785 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bdbe5a5a-5a8b-42cb-9522-d284095f6c0d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:00.931200 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bdbe5a5a-5a8b-42cb-9522-d284095f6c0d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:01.072987 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-bdbe5a5a-5a8b-42cb-9522-d284095f6c0d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:01.082356 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-bdbe5a5a-5a8b-42cb-9522-d284095f6c0d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d" status: 200 len: 1366 microversion: 2.1 time: 0.164776 Aug 12 01:32:01.082902 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 277/563] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:00 2022] GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:32:01.154352 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-c894bf3e-eb5b-4084-b9ea-a1d632308780 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:01.155088 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-c894bf3e-eb5b-4084-b9ea-a1d632308780 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:01.162321 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c894bf3e-eb5b-4084-b9ea-a1d632308780 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:01.163689 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c894bf3e-eb5b-4084-b9ea-a1d632308780 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:01.164372 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c894bf3e-eb5b-4084-b9ea-a1d632308780 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:01.165849 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c894bf3e-eb5b-4084-b9ea-a1d632308780 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:01.166517 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c894bf3e-eb5b-4084-b9ea-a1d632308780 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:01.167156 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c894bf3e-eb5b-4084-b9ea-a1d632308780 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:01.308617 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-c894bf3e-eb5b-4084-b9ea-a1d632308780 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:01.317017 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-c894bf3e-eb5b-4084-b9ea-a1d632308780 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1733 microversion: 2.1 time: 0.166583 Aug 12 01:32:01.317567 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 287/564] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:01 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1733 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:32:01.350024 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-52654b59-f049-4465-bca5-04b4b10253af tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:01.350550 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-52654b59-f049-4465-bca5-04b4b10253af tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:01.356796 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-52654b59-f049-4465-bca5-04b4b10253af tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:01.357276 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-52654b59-f049-4465-bca5-04b4b10253af tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:01.357706 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-52654b59-f049-4465-bca5-04b4b10253af tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:01.358516 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-52654b59-f049-4465-bca5-04b4b10253af tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:01.358957 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-52654b59-f049-4465-bca5-04b4b10253af tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:01.359374 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-52654b59-f049-4465-bca5-04b4b10253af tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:01.490799 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-52654b59-f049-4465-bca5-04b4b10253af tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:01.498678 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-52654b59-f049-4465-bca5-04b4b10253af tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1675 microversion: 2.1 time: 0.152606 Aug 12 01:32:01.499236 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 278/565] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:01 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:32:02.107605 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-8efbad5c-0799-472a-a67d-e04334438436 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:02.108143 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-8efbad5c-0799-472a-a67d-e04334438436 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 033d7c0c-b5ff-43bb-995d-500a2c087f7d] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:02.114332 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8efbad5c-0799-472a-a67d-e04334438436 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:02.114813 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8efbad5c-0799-472a-a67d-e04334438436 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:02.115240 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8efbad5c-0799-472a-a67d-e04334438436 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:02.115960 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8efbad5c-0799-472a-a67d-e04334438436 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:02.116406 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8efbad5c-0799-472a-a67d-e04334438436 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:02.116824 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8efbad5c-0799-472a-a67d-e04334438436 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:02.250422 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-8efbad5c-0799-472a-a67d-e04334438436 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:02.258138 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-8efbad5c-0799-472a-a67d-e04334438436 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d" status: 200 len: 1366 microversion: 2.1 time: 0.154480 Aug 12 01:32:02.258711 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 288/566] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:02 2022] GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:32:02.342400 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-35afc569-9566-4271-b847-382a14ed4218 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:02.343465 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-35afc569-9566-4271-b847-382a14ed4218 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:02.354345 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-35afc569-9566-4271-b847-382a14ed4218 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:02.355109 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-35afc569-9566-4271-b847-382a14ed4218 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:02.355904 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-35afc569-9566-4271-b847-382a14ed4218 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:02.357036 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-35afc569-9566-4271-b847-382a14ed4218 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:02.357875 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-35afc569-9566-4271-b847-382a14ed4218 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:02.358633 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-35afc569-9566-4271-b847-382a14ed4218 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:02.506655 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-35afc569-9566-4271-b847-382a14ed4218 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:02.516244 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-35afc569-9566-4271-b847-382a14ed4218 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1733 microversion: 2.1 time: 0.180137 Aug 12 01:32:02.517078 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 279/567] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:02 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1733 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:32:02.519817 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-fee11335-ed3f-460e-9155-98f294fd687f tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:02.520429 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-fee11335-ed3f-460e-9155-98f294fd687f tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:02.526639 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fee11335-ed3f-460e-9155-98f294fd687f tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:02.527116 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fee11335-ed3f-460e-9155-98f294fd687f tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:02.527572 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fee11335-ed3f-460e-9155-98f294fd687f tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:02.528323 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fee11335-ed3f-460e-9155-98f294fd687f tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:02.528767 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fee11335-ed3f-460e-9155-98f294fd687f tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:02.529210 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fee11335-ed3f-460e-9155-98f294fd687f tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:02.659113 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-fee11335-ed3f-460e-9155-98f294fd687f tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:02.666704 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-fee11335-ed3f-460e-9155-98f294fd687f tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1652 microversion: 2.1 time: 0.150816 Aug 12 01:32:02.667268 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 289/568] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:02 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1652 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:32:02.687167 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-7259f123-d378-49a0-a022-238a2fd324b7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:32:02.693649 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7259f123-d378-49a0-a022-238a2fd324b7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:02.694138 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7259f123-d378-49a0-a022-238a2fd324b7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:02.694594 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7259f123-d378-49a0-a022-238a2fd324b7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:02.717416 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-7259f123-d378-49a0-a022-238a2fd324b7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Going to try to start instance {{(pid=120785) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 12 01:32:02.724295 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-0280ab4b-56f7-4b1d-a96a-4d4d0f76941c req-4fd54f11-f434-4ed3-9d44-4fc5707ee613 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "033d7c0c-b5ff-43bb-995d-500a2c087f7d", "name": "network-vif-plugged", "status": "completed", "tag": "ce8f5755-06ab-4852-bd78-2e3e7aaea221"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:32:02.736561 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-0280ab4b-56f7-4b1d-a96a-4d4d0f76941c req-4fd54f11-f434-4ed3-9d44-4fc5707ee613 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:02.738297 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-0280ab4b-56f7-4b1d-a96a-4d4d0f76941c req-4fd54f11-f434-4ed3-9d44-4fc5707ee613 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:02.738297 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-0280ab4b-56f7-4b1d-a96a-4d4d0f76941c req-4fd54f11-f434-4ed3-9d44-4fc5707ee613 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:02.741652 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:02.752266 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-0280ab4b-56f7-4b1d-a96a-4d4d0f76941c req-4fd54f11-f434-4ed3-9d44-4fc5707ee613 service nova] Creating event network-vif-plugged:ce8f5755-06ab-4852-bd78-2e3e7aaea221 for instance 033d7c0c-b5ff-43bb-995d-500a2c087f7d on hv-cinder-78481 Aug 12 01:32:02.758160 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-0280ab4b-56f7-4b1d-a96a-4d4d0f76941c req-4fd54f11-f434-4ed3-9d44-4fc5707ee613 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038561 Aug 12 01:32:02.758906 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 290/569] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 01:32:02.763301 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-7259f123-d378-49a0-a022-238a2fd324b7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "POST /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a/action" status: 202 len: 0 microversion: 2.1 time: 0.079741 Aug 12 01:32:02.763933 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 280/570] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Aug 12 01:32:02 2022] POST /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 01:32:02.774721 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-2a810052-281a-4def-a37b-8648b36a58d3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:02.775781 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-2a810052-281a-4def-a37b-8648b36a58d3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:02.783583 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2a810052-281a-4def-a37b-8648b36a58d3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:02.784247 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2a810052-281a-4def-a37b-8648b36a58d3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:02.785637 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2a810052-281a-4def-a37b-8648b36a58d3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:02.786768 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2a810052-281a-4def-a37b-8648b36a58d3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:02.787302 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2a810052-281a-4def-a37b-8648b36a58d3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:02.787805 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2a810052-281a-4def-a37b-8648b36a58d3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:02.962411 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-2a810052-281a-4def-a37b-8648b36a58d3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:02.970249 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-2a810052-281a-4def-a37b-8648b36a58d3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1661 microversion: 2.1 time: 0.201707 Aug 12 01:32:02.983604 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 291/571] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:02 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1661 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:32:03.279961 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-c0bae10e-9bd3-4bff-81bc-8b10f1b2e287 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:03.280789 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-c0bae10e-9bd3-4bff-81bc-8b10f1b2e287 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 033d7c0c-b5ff-43bb-995d-500a2c087f7d] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:03.287769 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c0bae10e-9bd3-4bff-81bc-8b10f1b2e287 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:03.288235 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c0bae10e-9bd3-4bff-81bc-8b10f1b2e287 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:03.288665 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c0bae10e-9bd3-4bff-81bc-8b10f1b2e287 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:03.289351 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c0bae10e-9bd3-4bff-81bc-8b10f1b2e287 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:03.289800 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c0bae10e-9bd3-4bff-81bc-8b10f1b2e287 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:03.290274 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c0bae10e-9bd3-4bff-81bc-8b10f1b2e287 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:03.459628 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-c0bae10e-9bd3-4bff-81bc-8b10f1b2e287 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:03.469223 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-c0bae10e-9bd3-4bff-81bc-8b10f1b2e287 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d" status: 200 len: 1366 microversion: 2.1 time: 0.193616 Aug 12 01:32:03.469787 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 281/572] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:03 2022] GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:32:03.541606 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-03c2bd15-f38e-425c-817f-490a511967da tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:03.542582 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-03c2bd15-f38e-425c-817f-490a511967da tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:03.553523 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-03c2bd15-f38e-425c-817f-490a511967da tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:03.554640 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-03c2bd15-f38e-425c-817f-490a511967da tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:03.555353 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-03c2bd15-f38e-425c-817f-490a511967da tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:03.556582 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-03c2bd15-f38e-425c-817f-490a511967da tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:03.557318 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-03c2bd15-f38e-425c-817f-490a511967da tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:03.558010 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-03c2bd15-f38e-425c-817f-490a511967da tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:03.693040 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-03c2bd15-f38e-425c-817f-490a511967da tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:03.701110 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-03c2bd15-f38e-425c-817f-490a511967da tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1733 microversion: 2.1 time: 0.166077 Aug 12 01:32:03.701681 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 292/573] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:03 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1733 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:32:03.991499 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-224960d3-e73c-48bf-a634-c6476bbec703 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:03.992121 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-224960d3-e73c-48bf-a634-c6476bbec703 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:03.998085 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-224960d3-e73c-48bf-a634-c6476bbec703 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:03.998563 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-224960d3-e73c-48bf-a634-c6476bbec703 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:03.999022 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-224960d3-e73c-48bf-a634-c6476bbec703 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:03.999805 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-224960d3-e73c-48bf-a634-c6476bbec703 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:04.000232 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-224960d3-e73c-48bf-a634-c6476bbec703 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:04.000646 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-224960d3-e73c-48bf-a634-c6476bbec703 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:04.136798 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-224960d3-e73c-48bf-a634-c6476bbec703 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:04.149372 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-224960d3-e73c-48bf-a634-c6476bbec703 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1661 microversion: 2.1 time: 0.161464 Aug 12 01:32:04.150201 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 282/574] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:03 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1661 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:32:04.498412 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-98354550-08b7-4578-a749-de4be51f759e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:04.499421 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-98354550-08b7-4578-a749-de4be51f759e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 033d7c0c-b5ff-43bb-995d-500a2c087f7d] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:04.509300 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-98354550-08b7-4578-a749-de4be51f759e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:04.510066 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-98354550-08b7-4578-a749-de4be51f759e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:04.510759 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-98354550-08b7-4578-a749-de4be51f759e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:04.511959 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-98354550-08b7-4578-a749-de4be51f759e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:04.512683 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-98354550-08b7-4578-a749-de4be51f759e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:04.513396 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-98354550-08b7-4578-a749-de4be51f759e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:04.646291 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-98354550-08b7-4578-a749-de4be51f759e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:04.653791 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-98354550-08b7-4578-a749-de4be51f759e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d" status: 200 len: 1366 microversion: 2.1 time: 0.161830 Aug 12 01:32:04.654357 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 293/575] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:04 2022] GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:32:04.722839 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-a3caeb67-3a1c-439d-a6ac-0104ae658e1c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:04.723561 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-a3caeb67-3a1c-439d-a6ac-0104ae658e1c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:04.731242 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a3caeb67-3a1c-439d-a6ac-0104ae658e1c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:04.731772 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a3caeb67-3a1c-439d-a6ac-0104ae658e1c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:04.732166 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a3caeb67-3a1c-439d-a6ac-0104ae658e1c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:04.732927 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a3caeb67-3a1c-439d-a6ac-0104ae658e1c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:04.733416 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a3caeb67-3a1c-439d-a6ac-0104ae658e1c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:04.733866 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a3caeb67-3a1c-439d-a6ac-0104ae658e1c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:04.865092 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-a3caeb67-3a1c-439d-a6ac-0104ae658e1c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:04.873584 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-a3caeb67-3a1c-439d-a6ac-0104ae658e1c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1733 microversion: 2.1 time: 0.155093 Aug 12 01:32:04.874173 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 283/576] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:04 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:32:04.949476 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-a036aa9e-7cde-4cdd-8a87-a069b9e86802 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:04.950272 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-a036aa9e-7cde-4cdd-8a87-a069b9e86802 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:04.959606 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a036aa9e-7cde-4cdd-8a87-a069b9e86802 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:04.960320 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a036aa9e-7cde-4cdd-8a87-a069b9e86802 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:04.960970 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a036aa9e-7cde-4cdd-8a87-a069b9e86802 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:04.962055 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a036aa9e-7cde-4cdd-8a87-a069b9e86802 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:04.962733 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a036aa9e-7cde-4cdd-8a87-a069b9e86802 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:04.963512 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a036aa9e-7cde-4cdd-8a87-a069b9e86802 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:04.997101 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-a036aa9e-7cde-4cdd-8a87-a069b9e86802 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8/os-volume_attachments/0dd28f4b-8e05-40c8-8503-5ce1960bd019" status: 200 len: 194 microversion: 2.20 time: 0.054674 Aug 12 01:32:04.997743 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 294/577] 10.222.0.20 () {60 vars in 1454 bytes} [Fri Aug 12 01:32:04 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8/os-volume_attachments/0dd28f4b-8e05-40c8-8503-5ce1960bd019 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 01:32:05.064630 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-8f76c414-aca4-47ec-aafe-15981e5df5e2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:05.065016 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-8f76c414-aca4-47ec-aafe-15981e5df5e2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:05.071056 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8f76c414-aca4-47ec-aafe-15981e5df5e2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:05.071504 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8f76c414-aca4-47ec-aafe-15981e5df5e2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:05.072004 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8f76c414-aca4-47ec-aafe-15981e5df5e2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:05.072683 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8f76c414-aca4-47ec-aafe-15981e5df5e2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:05.073132 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8f76c414-aca4-47ec-aafe-15981e5df5e2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:05.073536 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8f76c414-aca4-47ec-aafe-15981e5df5e2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:05.130965 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:05.170189 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-925493e0-dbc0-4c1b-a38f-7cebf04bbea7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:05.171016 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-925493e0-dbc0-4c1b-a38f-7cebf04bbea7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:05.177111 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-925493e0-dbc0-4c1b-a38f-7cebf04bbea7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:05.177679 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-925493e0-dbc0-4c1b-a38f-7cebf04bbea7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:05.178174 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-925493e0-dbc0-4c1b-a38f-7cebf04bbea7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:05.179229 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-925493e0-dbc0-4c1b-a38f-7cebf04bbea7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:05.179677 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-925493e0-dbc0-4c1b-a38f-7cebf04bbea7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:05.180087 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-925493e0-dbc0-4c1b-a38f-7cebf04bbea7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:05.203907 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.objects.instance [None req-8f76c414-aca4-47ec-aafe-15981e5df5e2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lazy-loading 'services' on Instance uuid 0ed5ced2-87ad-4d0f-860c-648bcca91ca8 {{(pid=120785) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 01:32:05.318640 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-925493e0-dbc0-4c1b-a38f-7cebf04bbea7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:05.320381 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-8f76c414-aca4-47ec-aafe-15981e5df5e2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8/os-volume_attachments/0dd28f4b-8e05-40c8-8503-5ce1960bd019" status: 202 len: 0 microversion: 2.20 time: 0.259728 Aug 12 01:32:05.320977 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 284/578] 10.222.0.20 () {60 vars in 1457 bytes} [Fri Aug 12 01:32:05 2022] DELETE /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8/os-volume_attachments/0dd28f4b-8e05-40c8-8503-5ce1960bd019 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 12 01:32:05.326565 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-925493e0-dbc0-4c1b-a38f-7cebf04bbea7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1665 microversion: 2.1 time: 0.160178 Aug 12 01:32:05.327558 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 295/579] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:05 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1665 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:32:05.330298 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-e57a15bc-3131-4d7e-a419-4826294d7521 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:05.334171 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-e57a15bc-3131-4d7e-a419-4826294d7521 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:05.341347 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e57a15bc-3131-4d7e-a419-4826294d7521 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:05.341860 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e57a15bc-3131-4d7e-a419-4826294d7521 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:05.342396 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e57a15bc-3131-4d7e-a419-4826294d7521 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:05.342999 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e57a15bc-3131-4d7e-a419-4826294d7521 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:05.343457 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e57a15bc-3131-4d7e-a419-4826294d7521 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:05.343967 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e57a15bc-3131-4d7e-a419-4826294d7521 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:05.377055 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-e57a15bc-3131-4d7e-a419-4826294d7521 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051392 Aug 12 01:32:05.377599 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 285/580] 10.222.0.20 () {60 vars in 1343 bytes} [Fri Aug 12 01:32:05 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 01:32:05.685099 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-f58f82c9-377e-4ef2-8390-61bbdde134b7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:05.686115 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-f58f82c9-377e-4ef2-8390-61bbdde134b7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 033d7c0c-b5ff-43bb-995d-500a2c087f7d] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:05.694307 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f58f82c9-377e-4ef2-8390-61bbdde134b7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:05.694907 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f58f82c9-377e-4ef2-8390-61bbdde134b7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:05.695386 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f58f82c9-377e-4ef2-8390-61bbdde134b7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:05.696242 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f58f82c9-377e-4ef2-8390-61bbdde134b7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:05.696771 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f58f82c9-377e-4ef2-8390-61bbdde134b7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:05.697286 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f58f82c9-377e-4ef2-8390-61bbdde134b7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:05.840575 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-f58f82c9-377e-4ef2-8390-61bbdde134b7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:05.848711 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-f58f82c9-377e-4ef2-8390-61bbdde134b7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d" status: 200 len: 1556 microversion: 2.1 time: 0.170661 Aug 12 01:32:05.849285 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 296/581] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:05 2022] GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d => generated 1556 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:32:05.869414 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-7691d3cd-7582-431b-bc3f-51e811edd4e3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:05.869973 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-7691d3cd-7582-431b-bc3f-51e811edd4e3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 033d7c0c-b5ff-43bb-995d-500a2c087f7d] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:05.873477 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:05.878057 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7691d3cd-7582-431b-bc3f-51e811edd4e3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:05.878532 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7691d3cd-7582-431b-bc3f-51e811edd4e3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:05.878952 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7691d3cd-7582-431b-bc3f-51e811edd4e3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:05.879676 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7691d3cd-7582-431b-bc3f-51e811edd4e3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:05.880124 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7691d3cd-7582-431b-bc3f-51e811edd4e3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:05.880541 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7691d3cd-7582-431b-bc3f-51e811edd4e3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:05.894066 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-57d702df-bd95-4032-956b-34b6357d81de tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:05.894809 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-57d702df-bd95-4032-956b-34b6357d81de tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:05.900995 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-57d702df-bd95-4032-956b-34b6357d81de tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:05.901465 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-57d702df-bd95-4032-956b-34b6357d81de tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:05.901892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-57d702df-bd95-4032-956b-34b6357d81de tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:05.902579 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-57d702df-bd95-4032-956b-34b6357d81de tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:05.903026 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-57d702df-bd95-4032-956b-34b6357d81de tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:05.903442 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-57d702df-bd95-4032-956b-34b6357d81de tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:06.153172 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell0:SELECT=2 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:06.175417 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell0:SELECT=6 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:06.231991 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-7691d3cd-7582-431b-bc3f-51e811edd4e3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.366485 Aug 12 01:32:06.232788 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 286/582] 10.222.0.20 () {58 vars in 1275 bytes} [Fri Aug 12 01:32:05 2022] GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d/os-interface => generated 284 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:32:06.302382 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-57d702df-bd95-4032-956b-34b6357d81de tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:06.315115 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-57d702df-bd95-4032-956b-34b6357d81de tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1733 microversion: 2.1 time: 0.424607 Aug 12 01:32:06.315728 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 297/583] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:05 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1733 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:32:06.390148 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-5460f384-75b4-4733-a017-67c0e22c813f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:06.392468 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-5460f384-75b4-4733-a017-67c0e22c813f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:06.399094 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5460f384-75b4-4733-a017-67c0e22c813f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:06.399578 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5460f384-75b4-4733-a017-67c0e22c813f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:06.400018 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5460f384-75b4-4733-a017-67c0e22c813f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:06.400702 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5460f384-75b4-4733-a017-67c0e22c813f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:06.401143 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5460f384-75b4-4733-a017-67c0e22c813f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:06.401561 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5460f384-75b4-4733-a017-67c0e22c813f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:06.433320 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-5460f384-75b4-4733-a017-67c0e22c813f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047265 Aug 12 01:32:06.434222 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 287/584] 10.222.0.20 () {60 vars in 1343 bytes} [Fri Aug 12 01:32:06 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:32:06.505147 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-a3c769b7-eca6-45a2-8a0d-19764c96ec8e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:06.505848 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-a3c769b7-eca6-45a2-8a0d-19764c96ec8e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:06.508206 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell0:SELECT=6 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:06.516982 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a3c769b7-eca6-45a2-8a0d-19764c96ec8e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:06.517474 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a3c769b7-eca6-45a2-8a0d-19764c96ec8e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:06.517898 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a3c769b7-eca6-45a2-8a0d-19764c96ec8e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:06.518596 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a3c769b7-eca6-45a2-8a0d-19764c96ec8e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:06.519070 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a3c769b7-eca6-45a2-8a0d-19764c96ec8e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:06.519481 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a3c769b7-eca6-45a2-8a0d-19764c96ec8e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:06.559598 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-a3c769b7-eca6-45a2-8a0d-19764c96ec8e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Going to try to terminate instance {{(pid=120786) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 01:32:06.640005 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:06.654743 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-a3c769b7-eca6-45a2-8a0d-19764c96ec8e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 204 len: 0 microversion: 2.20 time: 0.154021 Aug 12 01:32:06.656279 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 298/585] 10.222.0.20 () {60 vars in 1280 bytes} [Fri Aug 12 01:32:06 2022] DELETE /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 12 01:32:06.665148 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-2a7e7ce7-e7c6-4931-85e8-31f3db3e5fca tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:06.665757 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-2a7e7ce7-e7c6-4931-85e8-31f3db3e5fca tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:06.672224 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2a7e7ce7-e7c6-4931-85e8-31f3db3e5fca tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:06.672727 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2a7e7ce7-e7c6-4931-85e8-31f3db3e5fca tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:06.673305 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2a7e7ce7-e7c6-4931-85e8-31f3db3e5fca tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:06.673998 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2a7e7ce7-e7c6-4931-85e8-31f3db3e5fca tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:06.674479 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2a7e7ce7-e7c6-4931-85e8-31f3db3e5fca tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:06.674894 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2a7e7ce7-e7c6-4931-85e8-31f3db3e5fca tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:06.808865 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-2a7e7ce7-e7c6-4931-85e8-31f3db3e5fca tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:06.817475 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-2a7e7ce7-e7c6-4931-85e8-31f3db3e5fca tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:06.818970 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-2a7e7ce7-e7c6-4931-85e8-31f3db3e5fca tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:06.820197 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-2a7e7ce7-e7c6-4931-85e8-31f3db3e5fca tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1725 microversion: 2.20 time: 0.159071 Aug 12 01:32:06.820768 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 288/586] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:32:06 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 01:32:07.337264 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-8012e84e-53d6-4a60-95c9-3eda472bd727 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:07.338070 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-8012e84e-53d6-4a60-95c9-3eda472bd727 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:07.345665 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8012e84e-53d6-4a60-95c9-3eda472bd727 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:07.346142 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8012e84e-53d6-4a60-95c9-3eda472bd727 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:07.346533 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8012e84e-53d6-4a60-95c9-3eda472bd727 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:07.347238 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8012e84e-53d6-4a60-95c9-3eda472bd727 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:07.347748 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8012e84e-53d6-4a60-95c9-3eda472bd727 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:07.348137 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8012e84e-53d6-4a60-95c9-3eda472bd727 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:07.457909 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-ff6c0e07-e706-46c5-9f09-8a2222d5c7ee req-369e773b-b8f6-46df-b60e-95660ea3862a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "033d7c0c-b5ff-43bb-995d-500a2c087f7d", "tag": "ce8f5755-06ab-4852-bd78-2e3e7aaea221"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:32:07.468381 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-ff6c0e07-e706-46c5-9f09-8a2222d5c7ee req-369e773b-b8f6-46df-b60e-95660ea3862a service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:07.468985 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-ff6c0e07-e706-46c5-9f09-8a2222d5c7ee req-369e773b-b8f6-46df-b60e-95660ea3862a service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:07.469506 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-ff6c0e07-e706-46c5-9f09-8a2222d5c7ee req-369e773b-b8f6-46df-b60e-95660ea3862a service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:07.482766 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-ff6c0e07-e706-46c5-9f09-8a2222d5c7ee req-369e773b-b8f6-46df-b60e-95660ea3862a service nova] Creating event network-changed:ce8f5755-06ab-4852-bd78-2e3e7aaea221 for instance 033d7c0c-b5ff-43bb-995d-500a2c087f7d on hv-cinder-78481 Aug 12 01:32:07.488419 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-ff6c0e07-e706-46c5-9f09-8a2222d5c7ee req-369e773b-b8f6-46df-b60e-95660ea3862a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034215 Aug 12 01:32:07.489029 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 289/587] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:32:07.491250 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-8012e84e-53d6-4a60-95c9-3eda472bd727 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:07.499848 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-8012e84e-53d6-4a60-95c9-3eda472bd727 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1733 microversion: 2.1 time: 0.167080 Aug 12 01:32:07.500744 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 299/588] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:07 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1733 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:32:07.844516 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-f72bc1b3-2fe0-4d7a-8132-258bd0061d32 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:07.845299 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-f72bc1b3-2fe0-4d7a-8132-258bd0061d32 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:07.852180 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f72bc1b3-2fe0-4d7a-8132-258bd0061d32 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:07.852678 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f72bc1b3-2fe0-4d7a-8132-258bd0061d32 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:07.853106 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f72bc1b3-2fe0-4d7a-8132-258bd0061d32 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:07.853835 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f72bc1b3-2fe0-4d7a-8132-258bd0061d32 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:07.854278 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f72bc1b3-2fe0-4d7a-8132-258bd0061d32 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:07.854675 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f72bc1b3-2fe0-4d7a-8132-258bd0061d32 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:08.017372 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-f72bc1b3-2fe0-4d7a-8132-258bd0061d32 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:08.025587 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-f72bc1b3-2fe0-4d7a-8132-258bd0061d32 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:08.027082 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-f72bc1b3-2fe0-4d7a-8132-258bd0061d32 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:08.028288 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-f72bc1b3-2fe0-4d7a-8132-258bd0061d32 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1725 microversion: 2.20 time: 0.188168 Aug 12 01:32:08.029065 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 290/589] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:32:07 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:32:08.521619 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-0c4feb54-101c-4d34-b309-ab040c48b2f1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:08.523085 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-0c4feb54-101c-4d34-b309-ab040c48b2f1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:08.530906 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0c4feb54-101c-4d34-b309-ab040c48b2f1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:08.531467 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0c4feb54-101c-4d34-b309-ab040c48b2f1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:08.531989 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0c4feb54-101c-4d34-b309-ab040c48b2f1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:08.532777 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0c4feb54-101c-4d34-b309-ab040c48b2f1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:08.533290 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0c4feb54-101c-4d34-b309-ab040c48b2f1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:08.533765 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0c4feb54-101c-4d34-b309-ab040c48b2f1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:08.678040 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-0c4feb54-101c-4d34-b309-ab040c48b2f1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:08.686558 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-0c4feb54-101c-4d34-b309-ab040c48b2f1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1733 microversion: 2.1 time: 0.168900 Aug 12 01:32:08.687133 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 300/590] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:08 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1733 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:32:08.938552 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-d5c270f7-8508-4dc4-b4e9-3bd5b185ec9a tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-124338040"}} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:32:08.939457 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-d5c270f7-8508-4dc4-b4e9-3bd5b185ec9a tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:08.950317 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d5c270f7-8508-4dc4-b4e9-3bd5b185ec9a tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:08.951118 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d5c270f7-8508-4dc4-b4e9-3bd5b185ec9a tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:08.951928 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d5c270f7-8508-4dc4-b4e9-3bd5b185ec9a tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:08.952646 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d5c270f7-8508-4dc4-b4e9-3bd5b185ec9a tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:08.953122 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d5c270f7-8508-4dc4-b4e9-3bd5b185ec9a tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:08.953572 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d5c270f7-8508-4dc4-b4e9-3bd5b185ec9a tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:09.050541 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-c166e24b-3c54-4c9c-8836-1844212e6fae tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:09.051226 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-c166e24b-3c54-4c9c-8836-1844212e6fae tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:09.058005 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c166e24b-3c54-4c9c-8836-1844212e6fae tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:09.058488 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c166e24b-3c54-4c9c-8836-1844212e6fae tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:09.058920 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c166e24b-3c54-4c9c-8836-1844212e6fae tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:09.059653 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c166e24b-3c54-4c9c-8836-1844212e6fae tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:09.060106 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c166e24b-3c54-4c9c-8836-1844212e6fae tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:09.060528 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c166e24b-3c54-4c9c-8836-1844212e6fae tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:09.088988 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.network.security_group_api [None req-d5c270f7-8508-4dc4-b4e9-3bd5b185ec9a tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Removing security group 3b7f5efd-9c46-49ab-bbac-4252551ebe86 from port 2fdb5157-5165-4135-b58d-b3f4cc47979a Aug 12 01:32:09.374995 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-c166e24b-3c54-4c9c-8836-1844212e6fae tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:09.384705 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-c166e24b-3c54-4c9c-8836-1844212e6fae tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:09.386664 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-c166e24b-3c54-4c9c-8836-1844212e6fae tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:09.388160 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-c166e24b-3c54-4c9c-8836-1844212e6fae tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1725 microversion: 2.20 time: 0.341502 Aug 12 01:32:09.389261 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 301/591] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:32:09 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1725 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:32:09.670356 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-d5c270f7-8508-4dc4-b4e9-3bd5b185ec9a tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "POST /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776/action" status: 202 len: 0 microversion: 2.1 time: 0.737571 Aug 12 01:32:09.676283 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 291/592] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Aug 12 01:32:08 2022] POST /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776/action => generated 0 bytes in 745 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 01:32:09.679945 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-a2102c5c-8513-4cb0-82ca-a0cbd58d769f req-81138e8e-de75-4728-b8e6-cbafc7089d09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32538820-dcc6-45ce-9b8b-dea8fe7e4776", "tag": "2fdb5157-5165-4135-b58d-b3f4cc47979a"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:32:09.690032 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-a2102c5c-8513-4cb0-82ca-a0cbd58d769f req-81138e8e-de75-4728-b8e6-cbafc7089d09 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:09.690854 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-a2102c5c-8513-4cb0-82ca-a0cbd58d769f req-81138e8e-de75-4728-b8e6-cbafc7089d09 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:09.691490 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-a2102c5c-8513-4cb0-82ca-a0cbd58d769f req-81138e8e-de75-4728-b8e6-cbafc7089d09 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:09.709676 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-cdcf413a-9e7a-41b2-85f6-e501c9650763 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:09.710685 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-cdcf413a-9e7a-41b2-85f6-e501c9650763 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:09.720645 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-a2102c5c-8513-4cb0-82ca-a0cbd58d769f req-81138e8e-de75-4728-b8e6-cbafc7089d09 service nova] Creating event network-changed:2fdb5157-5165-4135-b58d-b3f4cc47979a for instance 32538820-dcc6-45ce-9b8b-dea8fe7e4776 on hv-cinder-78481 Aug 12 01:32:09.722731 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cdcf413a-9e7a-41b2-85f6-e501c9650763 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:09.726745 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cdcf413a-9e7a-41b2-85f6-e501c9650763 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:09.727678 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cdcf413a-9e7a-41b2-85f6-e501c9650763 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:09.728645 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cdcf413a-9e7a-41b2-85f6-e501c9650763 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:09.729310 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cdcf413a-9e7a-41b2-85f6-e501c9650763 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:09.729961 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cdcf413a-9e7a-41b2-85f6-e501c9650763 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:09.736780 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-a2102c5c-8513-4cb0-82ca-a0cbd58d769f req-81138e8e-de75-4728-b8e6-cbafc7089d09 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060857 Aug 12 01:32:09.737712 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 302/593] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 01:32:09.958642 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-cdcf413a-9e7a-41b2-85f6-e501c9650763 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:09.968229 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-cdcf413a-9e7a-41b2-85f6-e501c9650763 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1733 microversion: 2.1 time: 0.262993 Aug 12 01:32:09.969263 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 292/594] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:09 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1733 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:32:10.411638 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-89620851-f5d6-49c2-b11f-815283cbd800 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:10.412446 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-89620851-f5d6-49c2-b11f-815283cbd800 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:10.423700 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-89620851-f5d6-49c2-b11f-815283cbd800 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:10.424446 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-89620851-f5d6-49c2-b11f-815283cbd800 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:10.425059 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-89620851-f5d6-49c2-b11f-815283cbd800 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:10.432661 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-89620851-f5d6-49c2-b11f-815283cbd800 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:10.433147 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-89620851-f5d6-49c2-b11f-815283cbd800 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:10.433573 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-89620851-f5d6-49c2-b11f-815283cbd800 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:10.471451 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-634aae59-7227-4e89-b62b-9daf4a7f5cd3 req-d4166161-5538-423c-98ef-b21211c150ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ed5ced2-87ad-4d0f-860c-648bcca91ca8", "name": "network-vif-deleted", "tag": "476d0433-5310-435b-93ea-c42ed83c3136"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:32:10.488069 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-634aae59-7227-4e89-b62b-9daf4a7f5cd3 req-d4166161-5538-423c-98ef-b21211c150ed service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:10.488549 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-634aae59-7227-4e89-b62b-9daf4a7f5cd3 req-d4166161-5538-423c-98ef-b21211c150ed service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:10.488976 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-634aae59-7227-4e89-b62b-9daf4a7f5cd3 req-d4166161-5538-423c-98ef-b21211c150ed service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:10.501699 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-634aae59-7227-4e89-b62b-9daf4a7f5cd3 req-d4166161-5538-423c-98ef-b21211c150ed service nova] Creating event network-vif-deleted:476d0433-5310-435b-93ea-c42ed83c3136 for instance 0ed5ced2-87ad-4d0f-860c-648bcca91ca8 on hv-cinder-78481 Aug 12 01:32:10.507884 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-634aae59-7227-4e89-b62b-9daf4a7f5cd3 req-d4166161-5538-423c-98ef-b21211c150ed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040016 Aug 12 01:32:10.508742 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 293/595] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 01:32:10.546366 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-89620851-f5d6-49c2-b11f-815283cbd800 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:10.556491 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-89620851-f5d6-49c2-b11f-815283cbd800 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:10.558006 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-89620851-f5d6-49c2-b11f-815283cbd800 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:10.559266 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-89620851-f5d6-49c2-b11f-815283cbd800 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 200 len: 1657 microversion: 2.20 time: 0.151932 Aug 12 01:32:10.560084 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 303/596] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:32:10 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 1657 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:32:10.990614 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-cda7ce9f-aba1-40eb-a19d-15fb706625cc tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:10.991300 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-cda7ce9f-aba1-40eb-a19d-15fb706625cc tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:10.997602 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cda7ce9f-aba1-40eb-a19d-15fb706625cc tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:10.998078 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cda7ce9f-aba1-40eb-a19d-15fb706625cc tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:10.998780 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cda7ce9f-aba1-40eb-a19d-15fb706625cc tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:10.999671 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cda7ce9f-aba1-40eb-a19d-15fb706625cc tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:11.000356 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cda7ce9f-aba1-40eb-a19d-15fb706625cc tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:11.000979 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cda7ce9f-aba1-40eb-a19d-15fb706625cc tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:11.278839 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-cda7ce9f-aba1-40eb-a19d-15fb706625cc tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:11.292342 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-cda7ce9f-aba1-40eb-a19d-15fb706625cc tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1733 microversion: 2.1 time: 0.306275 Aug 12 01:32:11.293551 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 294/597] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:10 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1733 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:32:11.455733 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-ca23dacc-a8b1-42b9-a638-06454cf4ab53 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:11.456302 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-ca23dacc-a8b1-42b9-a638-06454cf4ab53 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:11.462914 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ca23dacc-a8b1-42b9-a638-06454cf4ab53 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:11.463398 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ca23dacc-a8b1-42b9-a638-06454cf4ab53 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:11.463901 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ca23dacc-a8b1-42b9-a638-06454cf4ab53 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:11.464598 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ca23dacc-a8b1-42b9-a638-06454cf4ab53 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:11.465585 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ca23dacc-a8b1-42b9-a638-06454cf4ab53 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:11.466174 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ca23dacc-a8b1-42b9-a638-06454cf4ab53 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:11.549746 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.objects.instance [None req-ca23dacc-a8b1-42b9-a638-06454cf4ab53 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lazy-loading 'services' on Instance uuid 32538820-dcc6-45ce-9b8b-dea8fe7e4776 {{(pid=120786) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 01:32:11.582074 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-787e8153-273b-464a-83e0-d5d62fb62af9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:11.582725 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-787e8153-273b-464a-83e0-d5d62fb62af9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:11.588992 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-787e8153-273b-464a-83e0-d5d62fb62af9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:11.589996 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-787e8153-273b-464a-83e0-d5d62fb62af9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:11.589996 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-787e8153-273b-464a-83e0-d5d62fb62af9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:11.590554 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-787e8153-273b-464a-83e0-d5d62fb62af9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:11.590994 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-787e8153-273b-464a-83e0-d5d62fb62af9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:11.591402 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-787e8153-273b-464a-83e0-d5d62fb62af9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:11.609554 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.wsgi [None req-787e8153-273b-464a-83e0-d5d62fb62af9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] HTTP exception thrown: Instance 0ed5ced2-87ad-4d0f-860c-648bcca91ca8 could not be found. Aug 12 01:32:11.611190 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-787e8153-273b-464a-83e0-d5d62fb62af9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Request method failure captured: Aug 12 01:32:11.611190 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: request: GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 HTTP/1.1 Aug 12 01:32:11.611190 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept: application/json Aug 12 01:32:11.611190 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept-Encoding: identity Aug 12 01:32:11.611190 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Connection: close Aug 12 01:32:11.611190 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Length: 0 Aug 12 01:32:11.611190 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Type: application/json Aug 12 01:32:11.611190 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Host: 10.222.0.20 Aug 12 01:32:11.611190 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Openstack-System-Scope: None Aug 12 01:32:11.611190 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: User-Agent: python-urllib3/1.26.11 Aug 12 01:32:11.611190 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Auth-Token: gAAAAABi9ayu67ZpanV5Ulpxh2Oe0Hcix-rTEgBTp0llyvT16FiTV27_rmSNyGask3IkdhTFcR2jIXguLeUhBc7htEodmUDR6h-5Y40cY5hhta-yFn_ddYys-HSimYLkapigbR2EYJqW0qs8dkp4N2CF-fav2L1laz_y2otDQD_L5dIvw2ec7_0 Aug 12 01:32:11.611190 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Id: None Aug 12 01:32:11.611190 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Name: None Aug 12 01:32:11.611190 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Identity-Status: Confirmed Aug 12 01:32:11.611190 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Is-Admin-Project: True Aug 12 01:32:11.611190 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Openstack-Nova-Api-Version: 2.20 Aug 12 01:32:11.611190 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Id: default Aug 12 01:32:11.611190 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Name: Default Aug 12 01:32:11.611190 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Id: 9d33b640693442238516535af8320529 Aug 12 01:32:11.611190 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1840757724 Aug 12 01:32:11.611190 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Role: member,reader Aug 12 01:32:11.611190 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Roles: member,reader Aug 12 01:32:11.612980 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d33b640693442238516535af8320529"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d33b640693442238516535af8320529"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d33b640693442238516535af8320529"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d33b640693442238516535af8320529"}]}] Aug 12 01:32:11.612980 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1840757724 Aug 12 01:32:11.612980 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Id: 9d33b640693442238516535af8320529 Aug 12 01:32:11.612980 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1840757724 Aug 12 01:32:11.612980 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User: tempest-AttachVolumeShelveTestJSON-1840757724-project Aug 12 01:32:11.612980 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Id: default Aug 12 01:32:11.612980 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Name: Default Aug 12 01:32:11.612980 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Id: be3709a7f73442e79e7d5ad0c9389ac1 Aug 12 01:32:11.612980 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1840757724-project Aug 12 01:32:11.612980 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: method: > Aug 12 01:32:11.612980 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: exception: Instance 0ed5ced2-87ad-4d0f-860c-648bcca91ca8 could not be found. Aug 12 01:32:11.612980 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: action_args: {'id': '0ed5ced2-87ad-4d0f-860c-648bcca91ca8'} Aug 12 01:32:11.613823 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:32:11.613823 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:32:11.613823 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:32:11.613823 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:32:11.613823 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:32:11.613823 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:32:11.613823 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:32:11.613823 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:32:11.613823 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:32:11.613823 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:32:11.613823 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ed5ced2-87ad-4d0f-860c-648bcca91ca8 could not be found. Aug 12 01:32:11.613823 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:32:11.613823 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:32:11.613823 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:32:11.613823 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:32:11.613823 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:32:11.613823 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:32:11.613823 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:32:11.613823 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:32:11.613823 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:32:11.615216 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:32:11.615216 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 01:32:11.615216 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 01:32:11.615216 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:32:11.615216 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:32:11.615216 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:32:11.615216 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:32:11.615216 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ed5ced2-87ad-4d0f-860c-648bcca91ca8 could not be found. Aug 12 01:32:11.615216 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:32:11.615216 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:32:11.615216 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:32:11.615216 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:32:11.615216 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:32:11.615216 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:32:11.615216 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:32:11.615216 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:32:11.615216 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ed5ced2-87ad-4d0f-860c-648bcca91ca8 could not be found. Aug 12 01:32:11.615216 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:32:11.616349 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-787e8153-273b-464a-83e0-d5d62fb62af9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Returning 404 to user: Instance 0ed5ced2-87ad-4d0f-860c-648bcca91ca8 could not be found. {{(pid=120785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:32:11.616349 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-787e8153-273b-464a-83e0-d5d62fb62af9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 404 len: 111 microversion: 2.20 time: 0.034748 Aug 12 01:32:11.616349 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 295/598] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:32:11 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 12 01:32:11.624827 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-0833de55-0e6d-41fb-bcfd-4231266373d8 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '.version_select at 0x7f2ded15f5e0>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:11.657866 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-0833de55-0e6d-41fb-bcfd-4231266373d8 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1819394950" status: 204 len: 0 microversion: 2.20 time: 0.037785 Aug 12 01:32:11.659716 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-ca23dacc-a8b1-42b9-a638-06454cf4ab53 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "DELETE /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776/os-volume_attachments/61418625-5d38-4684-8763-dc45306cb067" status: 202 len: 0 microversion: 2.1 time: 0.208232 Aug 12 01:32:11.660319 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 304/599] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Aug 12 01:32:11 2022] DELETE /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776/os-volume_attachments/61418625-5d38-4684-8763-dc45306cb067 => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 01:32:11.661329 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 296/600] 10.222.0.20 () {60 vars in 1262 bytes} [Fri Aug 12 01:32:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1819394950 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 12 01:32:11.681307 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-c2784703-e74b-42cb-a2fe-d70512c84ced tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:11.683485 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-c2784703-e74b-42cb-a2fe-d70512c84ced tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:11.692427 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c2784703-e74b-42cb-a2fe-d70512c84ced tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:11.693281 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c2784703-e74b-42cb-a2fe-d70512c84ced tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:11.693892 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c2784703-e74b-42cb-a2fe-d70512c84ced tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:11.694793 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c2784703-e74b-42cb-a2fe-d70512c84ced tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:11.695448 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c2784703-e74b-42cb-a2fe-d70512c84ced tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:11.696357 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c2784703-e74b-42cb-a2fe-d70512c84ced tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:11.726720 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-c2784703-e74b-42cb-a2fe-d70512c84ced tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049689 Aug 12 01:32:11.727711 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 297/601] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 01:32:11 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:32:11.792488 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-982088ec-c8a1-43bb-a9fc-f6af258fc758 req-6527b4d6-0312-4f2a-b485-d1f2fa305f6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32538820-dcc6-45ce-9b8b-dea8fe7e4776", "tag": "2fdb5157-5165-4135-b58d-b3f4cc47979a"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:32:11.802547 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-982088ec-c8a1-43bb-a9fc-f6af258fc758 req-6527b4d6-0312-4f2a-b485-d1f2fa305f6d service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:11.803026 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-982088ec-c8a1-43bb-a9fc-f6af258fc758 req-6527b4d6-0312-4f2a-b485-d1f2fa305f6d service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:11.803458 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-982088ec-c8a1-43bb-a9fc-f6af258fc758 req-6527b4d6-0312-4f2a-b485-d1f2fa305f6d service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:11.815105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-982088ec-c8a1-43bb-a9fc-f6af258fc758 req-6527b4d6-0312-4f2a-b485-d1f2fa305f6d service nova] Creating event network-changed:2fdb5157-5165-4135-b58d-b3f4cc47979a for instance 32538820-dcc6-45ce-9b8b-dea8fe7e4776 on hv-cinder-78481 Aug 12 01:32:11.820066 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-982088ec-c8a1-43bb-a9fc-f6af258fc758 req-6527b4d6-0312-4f2a-b485-d1f2fa305f6d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031495 Aug 12 01:32:11.820909 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 305/602] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:32:12.320014 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-23e09158-f1c4-4775-9f59-6e5cd6a54b89 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:12.320659 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-23e09158-f1c4-4775-9f59-6e5cd6a54b89 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:12.340221 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-23e09158-f1c4-4775-9f59-6e5cd6a54b89 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:12.340717 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-23e09158-f1c4-4775-9f59-6e5cd6a54b89 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:12.341182 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-23e09158-f1c4-4775-9f59-6e5cd6a54b89 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:12.342243 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-23e09158-f1c4-4775-9f59-6e5cd6a54b89 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:12.342866 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-23e09158-f1c4-4775-9f59-6e5cd6a54b89 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:12.343509 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-23e09158-f1c4-4775-9f59-6e5cd6a54b89 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:12.360096 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-86f80de7-38fc-4b2a-a42d-55b0eeac445e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Action: 'create', calling method: .version_select at 0x7f2decd4dc10>, body: {"keypair": {"name": "tempest-keypair-1426147352", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItaUNpB7Gq0FYtsd60l9zc+tRipU96xMQVOZR3NK5f7ApGEL91pcQXBLhXPaUfoOZ/YonpxnWJp3/jGUeFKtFkk56KjX3yqMhnNrhvF8jMdqbk5nv6DV5y+jwxbxUoJsA=="}} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:32:12.378233 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.quota [None req-86f80de7-38fc-4b2a-a42d-55b0eeac445e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Getting quotas for project 9d33b640693442238516535af8320529. Resources: {'key_pairs'} {{(pid=120786) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 01:32:12.385169 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.quota [None req-86f80de7-38fc-4b2a-a42d-55b0eeac445e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Getting quotas for user be3709a7f73442e79e7d5ad0c9389ac1 and project 9d33b640693442238516535af8320529. Resources: {'key_pairs'} {{(pid=120786) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 01:32:12.422651 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-86f80de7-38fc-4b2a-a42d-55b0eeac445e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.069878 Aug 12 01:32:12.429575 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 306/603] 10.222.0.20 () {62 vars in 1200 bytes} [Fri Aug 12 01:32:12 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 72 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 12 01:32:12.541166 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-23e09158-f1c4-4775-9f59-6e5cd6a54b89 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:12.552142 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-23e09158-f1c4-4775-9f59-6e5cd6a54b89 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1713 microversion: 2.1 time: 0.240335 Aug 12 01:32:12.565256 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 298/604] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:12 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1713 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:32:12.696169 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-3aad893f-6248-44a6-9431-e9ab8bb3768e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:12.698583 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-3aad893f-6248-44a6-9431-e9ab8bb3768e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:12.711728 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3aad893f-6248-44a6-9431-e9ab8bb3768e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:12.713575 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3aad893f-6248-44a6-9431-e9ab8bb3768e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:12.715050 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3aad893f-6248-44a6-9431-e9ab8bb3768e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:12.716333 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3aad893f-6248-44a6-9431-e9ab8bb3768e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:12.724353 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3aad893f-6248-44a6-9431-e9ab8bb3768e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:12.725192 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3aad893f-6248-44a6-9431-e9ab8bb3768e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:12.740300 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-f59781ca-0208-4f6e-b2ee-33d1d6c1e306 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:12.744891 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-f59781ca-0208-4f6e-b2ee-33d1d6c1e306 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:12.758855 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f59781ca-0208-4f6e-b2ee-33d1d6c1e306 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:12.759733 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f59781ca-0208-4f6e-b2ee-33d1d6c1e306 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:12.760920 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f59781ca-0208-4f6e-b2ee-33d1d6c1e306 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:12.762315 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f59781ca-0208-4f6e-b2ee-33d1d6c1e306 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:12.763064 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f59781ca-0208-4f6e-b2ee-33d1d6c1e306 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:12.763520 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f59781ca-0208-4f6e-b2ee-33d1d6c1e306 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:12.775054 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:12.833502 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-f59781ca-0208-4f6e-b2ee-33d1d6c1e306 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.097573 Aug 12 01:32:12.839620 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 299/605] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 01:32:12 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776/os-volume_attachments => generated 25 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 12 01:32:12.844718 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-df06f450-5644-4504-8104-53a74afefc1c tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:12.845214 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-df06f450-5644-4504-8104-53a74afefc1c tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:12.851350 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-df06f450-5644-4504-8104-53a74afefc1c tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:12.851874 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-df06f450-5644-4504-8104-53a74afefc1c tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:12.852316 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-df06f450-5644-4504-8104-53a74afefc1c tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:12.853078 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-df06f450-5644-4504-8104-53a74afefc1c tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:12.853471 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-df06f450-5644-4504-8104-53a74afefc1c tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:12.853890 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-df06f450-5644-4504-8104-53a74afefc1c tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:12.867766 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.wsgi [None req-3aad893f-6248-44a6-9431-e9ab8bb3768e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] HTTP exception thrown: Cannot 'detach_volume' instance f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a while it is in vm_state rescued Aug 12 01:32:12.869392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-3aad893f-6248-44a6-9431-e9ab8bb3768e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Request method failure captured: Aug 12 01:32:12.869392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: request: DELETE /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a/os-volume_attachments/4a46cfd6-f449-4868-930e-d4cd2356ce0c HTTP/1.1 Aug 12 01:32:12.869392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept: application/json Aug 12 01:32:12.869392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept-Encoding: identity Aug 12 01:32:12.869392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Connection: close Aug 12 01:32:12.869392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Length: 0 Aug 12 01:32:12.869392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Type: application/json Aug 12 01:32:12.869392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Host: 10.222.0.20 Aug 12 01:32:12.869392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Openstack-System-Scope: None Aug 12 01:32:12.869392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: User-Agent: python-urllib3/1.26.11 Aug 12 01:32:12.869392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Auth-Token: gAAAAABi9ayoxsO4pebdlbGb3TfC7pdsTDHM0zBbhW1rROXCyh2X3MU63lrNyuI5JBIvpFkBHWmOhzN7hT_Ph2EuZvp68TczP4qOdjp2u2mGnkKXiIsRPx1ARWLioQm2PsX7zkhWbZDIo2KgE_MjWZnupOgbzAN6WD9weMJ2_q2Y0YfQ_YfoyX8 Aug 12 01:32:12.869392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Id: None Aug 12 01:32:12.869392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Name: None Aug 12 01:32:12.869392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Identity-Status: Confirmed Aug 12 01:32:12.869392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Is-Admin-Project: True Aug 12 01:32:12.869392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Id: default Aug 12 01:32:12.869392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Name: Default Aug 12 01:32:12.869392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Id: a0674e4f240748d69cc9be8fdc79ad89 Aug 12 01:32:12.869392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1607139389 Aug 12 01:32:12.869392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Role: member,reader Aug 12 01:32:12.869392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Roles: member,reader Aug 12 01:32:12.870701 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a0674e4f240748d69cc9be8fdc79ad89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0674e4f240748d69cc9be8fdc79ad89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a0674e4f240748d69cc9be8fdc79ad89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0674e4f240748d69cc9be8fdc79ad89"}]}] Aug 12 01:32:12.870701 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1607139389 Aug 12 01:32:12.870701 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Id: a0674e4f240748d69cc9be8fdc79ad89 Aug 12 01:32:12.870701 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1607139389 Aug 12 01:32:12.870701 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User: tempest-ServerRescueNegativeTestJSON-1607139389-project Aug 12 01:32:12.870701 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Id: default Aug 12 01:32:12.870701 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Name: Default Aug 12 01:32:12.870701 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Id: fed1b143e80642328bb5c7c78cacedcd Aug 12 01:32:12.870701 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1607139389-project Aug 12 01:32:12.870701 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: method: > Aug 12 01:32:12.870701 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: exception: Cannot 'detach_volume' instance f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a while it is in vm_state rescued Aug 12 01:32:12.873104 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: action_args: {'server_id': 'f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a', 'id': '4a46cfd6-f449-4868-930e-d4cd2356ce0c'} Aug 12 01:32:12.873104 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:32:12.873104 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:32:12.873104 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 12 01:32:12.873104 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 12 01:32:12.873104 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 12 01:32:12.873104 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 12 01:32:12.873104 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 12 01:32:12.873104 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 12 01:32:12.873104 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 12 01:32:12.873104 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:32:12.873104 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:32:12.873104 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:32:12.873104 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:32:12.873104 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:32:12.873104 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:32:12.873104 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:32:12.873104 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:32:12.873104 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:32:12.873104 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:32:12.876135 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 12 01:32:12.876135 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 12 01:32:12.876135 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 12 01:32:12.876135 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 12 01:32:12.876135 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a while it is in vm_state rescued Aug 12 01:32:12.876135 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:32:12.876135 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:32:12.876135 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:32:12.876135 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:32:12.876135 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:32:12.876135 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:32:12.876135 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:32:12.876135 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:32:12.876135 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a while it is in vm_state rescued Aug 12 01:32:12.876135 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:32:12.876135 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-3aad893f-6248-44a6-9431-e9ab8bb3768e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Returning 409 to user: Cannot 'detach_volume' instance f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a while it is in vm_state rescued {{(pid=120786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:32:12.877248 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-3aad893f-6248-44a6-9431-e9ab8bb3768e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a/os-volume_attachments/4a46cfd6-f449-4868-930e-d4cd2356ce0c" status: 409 len: 152 microversion: 2.1 time: 0.182976 Aug 12 01:32:12.877248 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 307/606] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Aug 12 01:32:12 2022] DELETE /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a/os-volume_attachments/4a46cfd6-f449-4868-930e-d4cd2356ce0c => generated 152 bytes in 184 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 12 01:32:12.880973 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-77288f79-1af6-4d44-af86-1e9e77ba0aec tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:32:12.881690 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-77288f79-1af6-4d44-af86-1e9e77ba0aec tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:12.888741 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-77288f79-1af6-4d44-af86-1e9e77ba0aec tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:12.889527 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-77288f79-1af6-4d44-af86-1e9e77ba0aec tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:12.889949 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-77288f79-1af6-4d44-af86-1e9e77ba0aec tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:12.891086 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-77288f79-1af6-4d44-af86-1e9e77ba0aec tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:12.891449 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-77288f79-1af6-4d44-af86-1e9e77ba0aec tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:12.895079 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-77288f79-1af6-4d44-af86-1e9e77ba0aec tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:12.946309 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.wsgi [None req-df06f450-5644-4504-8104-53a74afefc1c tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] HTTP exception thrown: Instance 32538820-dcc6-45ce-9b8b-dea8fe7e4776 is not attached to volume 61418625-5d38-4684-8763-dc45306cb067 Aug 12 01:32:12.948845 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-df06f450-5644-4504-8104-53a74afefc1c tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Request method failure captured: Aug 12 01:32:12.948845 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: request: DELETE /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776/os-volume_attachments/61418625-5d38-4684-8763-dc45306cb067 HTTP/1.1 Aug 12 01:32:12.948845 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept: application/json Aug 12 01:32:12.948845 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept-Encoding: identity Aug 12 01:32:12.948845 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Connection: close Aug 12 01:32:12.948845 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Length: 0 Aug 12 01:32:12.948845 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Type: application/json Aug 12 01:32:12.948845 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Host: 10.222.0.20 Aug 12 01:32:12.948845 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Openstack-System-Scope: None Aug 12 01:32:12.948845 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: User-Agent: python-urllib3/1.26.11 Aug 12 01:32:12.948845 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Auth-Token: gAAAAABi9azhfqoNTrPPk348_iOHTVdfn-VxkfW7u6wyx4zoggmSpMqI9FGC6vJCyYanjiEwiW_rL5_sSRjP72wNlgSmiHrxckzJd3w0OTpEEUr0qCCzNaIP9r99SqAaCBi3O7crgG2yWyLdhI81I9L9XaMh2puueaplq1MUdgDSW0bQXrcVOHQ Aug 12 01:32:12.948845 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Id: None Aug 12 01:32:12.948845 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Name: None Aug 12 01:32:12.948845 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Identity-Status: Confirmed Aug 12 01:32:12.948845 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Is-Admin-Project: True Aug 12 01:32:12.948845 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Id: default Aug 12 01:32:12.948845 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Name: Default Aug 12 01:32:12.948845 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Id: 135531dcbc244552aef21e5d555da3c4 Aug 12 01:32:12.948845 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Name: tempest-TestMinimumBasicScenario-1914149486 Aug 12 01:32:12.948845 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Role: member,reader Aug 12 01:32:12.948845 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Roles: member,reader Aug 12 01:32:12.950309 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/135531dcbc244552aef21e5d555da3c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/135531dcbc244552aef21e5d555da3c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_135531dcbc244552aef21e5d555da3c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/135531dcbc244552aef21e5d555da3c4"}]}] Aug 12 01:32:12.950309 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant: tempest-TestMinimumBasicScenario-1914149486 Aug 12 01:32:12.950309 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Id: 135531dcbc244552aef21e5d555da3c4 Aug 12 01:32:12.950309 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1914149486 Aug 12 01:32:12.950309 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User: tempest-TestMinimumBasicScenario-1914149486-project Aug 12 01:32:12.950309 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Id: default Aug 12 01:32:12.950309 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Name: Default Aug 12 01:32:12.950309 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Id: 15481d01cf6d4c67af858859f74a1607 Aug 12 01:32:12.950309 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Name: tempest-TestMinimumBasicScenario-1914149486-project Aug 12 01:32:12.950309 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: method: > Aug 12 01:32:12.950309 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: exception: Instance 32538820-dcc6-45ce-9b8b-dea8fe7e4776 is not attached to volume 61418625-5d38-4684-8763-dc45306cb067 Aug 12 01:32:12.951054 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: action_args: {'server_id': '32538820-dcc6-45ce-9b8b-dea8fe7e4776', 'id': '61418625-5d38-4684-8763-dc45306cb067'} Aug 12 01:32:12.951054 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:32:12.951054 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:32:12.951054 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 12 01:32:12.951054 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 12 01:32:12.951054 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 12 01:32:12.951054 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 12 01:32:12.951054 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 12 01:32:12.951054 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 12 01:32:12.951054 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 61418625-5d38-4684-8763-dc45306cb067. Aug 12 01:32:12.951054 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:32:12.951054 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:32:12.951054 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:32:12.951054 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:32:12.951054 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:32:12.951054 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:32:12.951054 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:32:12.951054 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:32:12.951054 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:32:12.952304 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:32:12.952304 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 12 01:32:12.952304 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 12 01:32:12.952304 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32538820-dcc6-45ce-9b8b-dea8fe7e4776 is not attached to volume 61418625-5d38-4684-8763-dc45306cb067 Aug 12 01:32:12.952304 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:32:12.952304 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:32:12.952304 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:32:12.952304 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:32:12.952304 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:32:12.952304 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:32:12.952304 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:32:12.952304 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:32:12.952304 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32538820-dcc6-45ce-9b8b-dea8fe7e4776 is not attached to volume 61418625-5d38-4684-8763-dc45306cb067 Aug 12 01:32:12.952304 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:32:12.952304 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-df06f450-5644-4504-8104-53a74afefc1c tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Returning 404 to user: Instance 32538820-dcc6-45ce-9b8b-dea8fe7e4776 is not attached to volume 61418625-5d38-4684-8763-dc45306cb067 {{(pid=120785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:32:12.953240 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-df06f450-5644-4504-8104-53a74afefc1c tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "DELETE /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776/os-volume_attachments/61418625-5d38-4684-8763-dc45306cb067" status: 404 len: 154 microversion: 2.1 time: 0.109684 Aug 12 01:32:12.953240 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 300/607] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Aug 12 01:32:12 2022] DELETE /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776/os-volume_attachments/61418625-5d38-4684-8763-dc45306cb067 => generated 154 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:32:12.974412 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-77288f79-1af6-4d44-af86-1e9e77ba0aec tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "POST /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a/action" status: 202 len: 0 microversion: 2.1 time: 0.097083 Aug 12 01:32:12.975215 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 308/608] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Aug 12 01:32:12 2022] POST /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 01:32:12.989622 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-04216265-2536-490a-98e2-2cace7a5f448 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:12.990207 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-04216265-2536-490a-98e2-2cace7a5f448 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:12.998276 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-04216265-2536-490a-98e2-2cace7a5f448 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:12.998806 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-04216265-2536-490a-98e2-2cace7a5f448 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:12.999317 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-04216265-2536-490a-98e2-2cace7a5f448 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:13.001657 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-04216265-2536-490a-98e2-2cace7a5f448 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:13.002137 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-04216265-2536-490a-98e2-2cace7a5f448 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:13.002668 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-04216265-2536-490a-98e2-2cace7a5f448 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:13.242942 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-04216265-2536-490a-98e2-2cace7a5f448 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:13.254123 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-04216265-2536-490a-98e2-2cace7a5f448 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1721 microversion: 2.1 time: 0.273134 Aug 12 01:32:13.255118 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 301/609] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:12 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1721 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:32:14.072267 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-b73f833b-b0bc-432b-b852-0788c10dc57c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1880558218", "imageRef": "0d77ae04-91a5-4e2b-8817-72986618c549", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bdc64372-39dc-45f5-ae9b-e7b46a872a57"}], "security_groups": [{"name": "tempest-securitygroup--303528549"}], "key_name": "tempest-keypair-1426147352", "user_data": "}} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:32:14.115135 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-4b9904bb-881d-4635-aec9-cee1433a26df tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:14.115849 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-4b9904bb-881d-4635-aec9-cee1433a26df tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:14.122380 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4b9904bb-881d-4635-aec9-cee1433a26df tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:14.122863 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4b9904bb-881d-4635-aec9-cee1433a26df tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:14.123452 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4b9904bb-881d-4635-aec9-cee1433a26df tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:14.124196 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4b9904bb-881d-4635-aec9-cee1433a26df tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:14.124643 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4b9904bb-881d-4635-aec9-cee1433a26df tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:14.125047 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4b9904bb-881d-4635-aec9-cee1433a26df tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:14.150421 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-4b9904bb-881d-4635-aec9-cee1433a26df tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Going to try to terminate instance {{(pid=120785) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 01:32:14.177241 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.network.neutron [None req-b73f833b-b0bc-432b-b852-0788c10dc57c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] validate_networks() for [('bdc64372-39dc-45f5-ae9b-e7b46a872a57', None, None, None, None, None)] {{(pid=120786) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 01:32:14.195975 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:14.228479 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-4b9904bb-881d-4635-aec9-cee1433a26df tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "DELETE /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 204 len: 0 microversion: 2.1 time: 0.117243 Aug 12 01:32:14.229060 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 302/610] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 01:32:14 2022] DELETE /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 01:32:14.237801 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-dedc4107-51d9-4575-9844-2708888630b6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:14.238646 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-dedc4107-51d9-4575-9844-2708888630b6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:14.244807 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-dedc4107-51d9-4575-9844-2708888630b6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:14.245288 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-dedc4107-51d9-4575-9844-2708888630b6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:14.245722 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-dedc4107-51d9-4575-9844-2708888630b6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:14.246407 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-dedc4107-51d9-4575-9844-2708888630b6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:14.246846 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-dedc4107-51d9-4575-9844-2708888630b6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:14.247267 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-dedc4107-51d9-4575-9844-2708888630b6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:14.439811 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-dedc4107-51d9-4575-9844-2708888630b6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:14.447773 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-dedc4107-51d9-4575-9844-2708888630b6 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1554 microversion: 2.1 time: 0.213969 Aug 12 01:32:14.448359 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 303/611] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:14 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1554 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:32:14.461792 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-c2528ac3-698f-4bc4-9dcd-38a5c2cb6b3e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:14.461792 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-c2528ac3-698f-4bc4-9dcd-38a5c2cb6b3e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:14.461792 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c2528ac3-698f-4bc4-9dcd-38a5c2cb6b3e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:14.461792 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c2528ac3-698f-4bc4-9dcd-38a5c2cb6b3e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:14.462223 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c2528ac3-698f-4bc4-9dcd-38a5c2cb6b3e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:14.462223 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c2528ac3-698f-4bc4-9dcd-38a5c2cb6b3e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:14.462223 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c2528ac3-698f-4bc4-9dcd-38a5c2cb6b3e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:14.462481 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c2528ac3-698f-4bc4-9dcd-38a5c2cb6b3e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:14.879331 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-c2528ac3-698f-4bc4-9dcd-38a5c2cb6b3e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:14.889975 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-c2528ac3-698f-4bc4-9dcd-38a5c2cb6b3e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1721 microversion: 2.1 time: 0.440568 Aug 12 01:32:14.890594 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 304/612] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:14 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1721 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:32:14.931993 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-b73f833b-b0bc-432b-b852-0788c10dc57c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Flavor limits 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 01:32:14.932446 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-b73f833b-b0bc-432b-b852-0788c10dc57c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Image limits 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 01:32:14.932919 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-b73f833b-b0bc-432b-b852-0788c10dc57c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Flavor pref 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 01:32:14.933322 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-b73f833b-b0bc-432b-b852-0788c10dc57c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Image pref 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 01:32:14.933728 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-b73f833b-b0bc-432b-b852-0788c10dc57c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 01:32:14.943392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b73f833b-b0bc-432b-b852-0788c10dc57c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:14.943893 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b73f833b-b0bc-432b-b852-0788c10dc57c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:14.944317 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b73f833b-b0bc-432b-b852-0788c10dc57c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:14.945028 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b73f833b-b0bc-432b-b852-0788c10dc57c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:14.945474 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b73f833b-b0bc-432b-b852-0788c10dc57c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:14.946010 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b73f833b-b0bc-432b-b852-0788c10dc57c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:14.963103 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.quota [None req-b73f833b-b0bc-432b-b852-0788c10dc57c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Getting quotas for project 9d33b640693442238516535af8320529. Resources: {'cores', 'ram', 'instances'} {{(pid=120786) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 01:32:14.967025 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.quota [None req-b73f833b-b0bc-432b-b852-0788c10dc57c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Getting quotas for user be3709a7f73442e79e7d5ad0c9389ac1 and project 9d33b640693442238516535af8320529. Resources: {'cores', 'ram', 'instances'} {{(pid=120786) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 01:32:14.977974 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-b73f833b-b0bc-432b-b852-0788c10dc57c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Going to run 1 instances... {{(pid=120786) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 01:32:14.980379 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-b73f833b-b0bc-432b-b852-0788c10dc57c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d77ae04-91a5-4e2b-8817-72986618c549',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120786) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 01:32:15.027523 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-b73f833b-b0bc-432b-b852-0788c10dc57c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.960612 Aug 12 01:32:15.028270 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 309/613] 10.222.0.20 () {62 vars in 1188 bytes} [Fri Aug 12 01:32:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 962 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 12 01:32:15.039297 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-8df9f684-3dc3-4ed1-ae89-5bd4bf05d2e2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:15.039928 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-8df9f684-3dc3-4ed1-ae89-5bd4bf05d2e2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:15.096072 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-8df9f684-3dc3-4ed1-ae89-5bd4bf05d2e2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:15.103630 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-8df9f684-3dc3-4ed1-ae89-5bd4bf05d2e2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:15.105301 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-8df9f684-3dc3-4ed1-ae89-5bd4bf05d2e2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:15.106449 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-8df9f684-3dc3-4ed1-ae89-5bd4bf05d2e2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1282 microversion: 2.20 time: 0.071156 Aug 12 01:32:15.107078 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 305/614] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:32:15 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1282 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:32:15.471875 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-2280c2f8-d65c-402b-88e8-ff3d8f357cad tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:15.472462 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-2280c2f8-d65c-402b-88e8-ff3d8f357cad tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:15.479794 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2280c2f8-d65c-402b-88e8-ff3d8f357cad tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:15.480269 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2280c2f8-d65c-402b-88e8-ff3d8f357cad tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:15.480701 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2280c2f8-d65c-402b-88e8-ff3d8f357cad tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:15.481391 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2280c2f8-d65c-402b-88e8-ff3d8f357cad tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:15.481836 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2280c2f8-d65c-402b-88e8-ff3d8f357cad tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:15.482259 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2280c2f8-d65c-402b-88e8-ff3d8f357cad tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:15.616085 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-2280c2f8-d65c-402b-88e8-ff3d8f357cad tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:15.624419 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-2280c2f8-d65c-402b-88e8-ff3d8f357cad tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1554 microversion: 2.1 time: 0.157509 Aug 12 01:32:15.624959 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 310/615] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:15 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:32:15.914652 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-064b772b-8303-4d11-a381-9874dc623082 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:15.915456 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-064b772b-8303-4d11-a381-9874dc623082 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:15.924352 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-064b772b-8303-4d11-a381-9874dc623082 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:15.924834 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-064b772b-8303-4d11-a381-9874dc623082 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:15.925267 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-064b772b-8303-4d11-a381-9874dc623082 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:15.925955 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-064b772b-8303-4d11-a381-9874dc623082 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:15.926424 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-064b772b-8303-4d11-a381-9874dc623082 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:15.926849 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-064b772b-8303-4d11-a381-9874dc623082 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:16.055189 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-064b772b-8303-4d11-a381-9874dc623082 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:16.063329 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-064b772b-8303-4d11-a381-9874dc623082 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1721 microversion: 2.1 time: 0.155240 Aug 12 01:32:16.063924 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 306/616] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:15 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:32:16.129833 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-f293c8b3-3044-43b6-8d8f-1984d5f2b5bc tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:16.130438 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-f293c8b3-3044-43b6-8d8f-1984d5f2b5bc tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:16.136900 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f293c8b3-3044-43b6-8d8f-1984d5f2b5bc tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:16.137383 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f293c8b3-3044-43b6-8d8f-1984d5f2b5bc tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:16.137811 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f293c8b3-3044-43b6-8d8f-1984d5f2b5bc tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:16.138498 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f293c8b3-3044-43b6-8d8f-1984d5f2b5bc tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:16.138945 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f293c8b3-3044-43b6-8d8f-1984d5f2b5bc tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:16.139362 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f293c8b3-3044-43b6-8d8f-1984d5f2b5bc tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:16.210158 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-f293c8b3-3044-43b6-8d8f-1984d5f2b5bc tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:16.218645 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-f293c8b3-3044-43b6-8d8f-1984d5f2b5bc tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:16.220172 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-f293c8b3-3044-43b6-8d8f-1984d5f2b5bc tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:16.221269 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-f293c8b3-3044-43b6-8d8f-1984d5f2b5bc tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1286 microversion: 2.20 time: 0.095416 Aug 12 01:32:16.221826 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 311/617] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:32:16 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:32:16.646888 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-7d83ae29-9559-40fa-91d4-1fd494a56bff tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:16.647407 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-7d83ae29-9559-40fa-91d4-1fd494a56bff tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:16.654222 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7d83ae29-9559-40fa-91d4-1fd494a56bff tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:16.655022 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7d83ae29-9559-40fa-91d4-1fd494a56bff tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:16.655461 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7d83ae29-9559-40fa-91d4-1fd494a56bff tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:16.656184 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7d83ae29-9559-40fa-91d4-1fd494a56bff tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:16.656617 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7d83ae29-9559-40fa-91d4-1fd494a56bff tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:16.657038 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7d83ae29-9559-40fa-91d4-1fd494a56bff tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:16.802799 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-7d83ae29-9559-40fa-91d4-1fd494a56bff tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:16.811392 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-7d83ae29-9559-40fa-91d4-1fd494a56bff tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1554 microversion: 2.1 time: 0.168615 Aug 12 01:32:16.812004 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 307/618] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:16 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:32:17.088585 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-20ad43db-fc22-49bb-b7c7-80e5d56bf1f2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:17.089608 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-20ad43db-fc22-49bb-b7c7-80e5d56bf1f2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:17.097519 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-20ad43db-fc22-49bb-b7c7-80e5d56bf1f2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:17.098005 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-20ad43db-fc22-49bb-b7c7-80e5d56bf1f2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:17.098438 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-20ad43db-fc22-49bb-b7c7-80e5d56bf1f2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:17.099133 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-20ad43db-fc22-49bb-b7c7-80e5d56bf1f2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:17.099590 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-20ad43db-fc22-49bb-b7c7-80e5d56bf1f2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:17.100038 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-20ad43db-fc22-49bb-b7c7-80e5d56bf1f2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:17.243512 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-d7162a2f-a71b-4f0d-ba32-b2ffc0eeb422 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:17.244158 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-d7162a2f-a71b-4f0d-ba32-b2ffc0eeb422 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:17.245823 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-20ad43db-fc22-49bb-b7c7-80e5d56bf1f2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:17.262002 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d7162a2f-a71b-4f0d-ba32-b2ffc0eeb422 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:17.262511 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d7162a2f-a71b-4f0d-ba32-b2ffc0eeb422 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:17.263487 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d7162a2f-a71b-4f0d-ba32-b2ffc0eeb422 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:17.263716 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d7162a2f-a71b-4f0d-ba32-b2ffc0eeb422 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:17.264248 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d7162a2f-a71b-4f0d-ba32-b2ffc0eeb422 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:17.264735 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d7162a2f-a71b-4f0d-ba32-b2ffc0eeb422 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:17.265273 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-20ad43db-fc22-49bb-b7c7-80e5d56bf1f2 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1727 microversion: 2.1 time: 0.183113 Aug 12 01:32:17.266616 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 312/619] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:17 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1727 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:32:17.287485 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-c0725cf1-b84a-41d4-ba5b-eefdfde618da tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:17.288354 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-c0725cf1-b84a-41d4-ba5b-eefdfde618da tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:17.300598 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c0725cf1-b84a-41d4-ba5b-eefdfde618da tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:17.302089 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c0725cf1-b84a-41d4-ba5b-eefdfde618da tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:17.303052 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c0725cf1-b84a-41d4-ba5b-eefdfde618da tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:17.304128 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c0725cf1-b84a-41d4-ba5b-eefdfde618da tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:17.313283 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c0725cf1-b84a-41d4-ba5b-eefdfde618da tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:17.313994 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c0725cf1-b84a-41d4-ba5b-eefdfde618da tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:17.374203 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-d7162a2f-a71b-4f0d-ba32-b2ffc0eeb422 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:17.384346 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-d7162a2f-a71b-4f0d-ba32-b2ffc0eeb422 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:17.386092 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-d7162a2f-a71b-4f0d-ba32-b2ffc0eeb422 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:17.387559 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-d7162a2f-a71b-4f0d-ba32-b2ffc0eeb422 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1278 microversion: 2.20 time: 0.148049 Aug 12 01:32:17.402758 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 308/620] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:32:17 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:32:17.424582 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-c0725cf1-b84a-41d4-ba5b-eefdfde618da tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.141387 Aug 12 01:32:17.425268 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 313/621] 10.222.0.20 () {58 vars in 1275 bytes} [Fri Aug 12 01:32:17 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a/os-interface => generated 284 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:32:17.750460 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-05af7885-0a9f-480d-a4cb-ff6b6aa0e378 req-4d001e87-58d7-4475-be5e-5d9834f06c47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32538820-dcc6-45ce-9b8b-dea8fe7e4776", "name": "network-vif-deleted", "tag": "2fdb5157-5165-4135-b58d-b3f4cc47979a"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:32:17.760083 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-05af7885-0a9f-480d-a4cb-ff6b6aa0e378 req-4d001e87-58d7-4475-be5e-5d9834f06c47 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:17.760664 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-05af7885-0a9f-480d-a4cb-ff6b6aa0e378 req-4d001e87-58d7-4475-be5e-5d9834f06c47 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:17.761156 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-05af7885-0a9f-480d-a4cb-ff6b6aa0e378 req-4d001e87-58d7-4475-be5e-5d9834f06c47 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:17.772562 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-05af7885-0a9f-480d-a4cb-ff6b6aa0e378 req-4d001e87-58d7-4475-be5e-5d9834f06c47 service nova] Creating event network-vif-deleted:2fdb5157-5165-4135-b58d-b3f4cc47979a for instance 32538820-dcc6-45ce-9b8b-dea8fe7e4776 on hv-cinder-78481 Aug 12 01:32:17.777448 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-05af7885-0a9f-480d-a4cb-ff6b6aa0e378 req-4d001e87-58d7-4475-be5e-5d9834f06c47 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030861 Aug 12 01:32:17.778183 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 309/622] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:32:17.834472 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-a31f5336-8bb8-41f0-a893-81f83a510935 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:17.835212 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-a31f5336-8bb8-41f0-a893-81f83a510935 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:17.841529 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a31f5336-8bb8-41f0-a893-81f83a510935 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:17.842057 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a31f5336-8bb8-41f0-a893-81f83a510935 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:17.842472 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a31f5336-8bb8-41f0-a893-81f83a510935 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:17.843173 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a31f5336-8bb8-41f0-a893-81f83a510935 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:17.843636 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a31f5336-8bb8-41f0-a893-81f83a510935 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:17.844053 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a31f5336-8bb8-41f0-a893-81f83a510935 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:17.945052 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-a31f5336-8bb8-41f0-a893-81f83a510935 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:17.958980 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-a31f5336-8bb8-41f0-a893-81f83a510935 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1512 microversion: 2.1 time: 0.128321 Aug 12 01:32:17.961395 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 314/623] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:17 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1512 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:32:18.415486 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-144c8791-f021-4294-bb0e-d344894642f9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:18.418630 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-144c8791-f021-4294-bb0e-d344894642f9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:18.428335 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-78bec1e6-555d-4b41-902d-d89b2a37f925 req-bfdeb69f-eb1e-45fd-bfb3-7eed9007bc3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a", "tag": "dc2ec8af-df9c-48b9-af2f-f3d087bf0f93"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:32:18.442831 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-144c8791-f021-4294-bb0e-d344894642f9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:18.443449 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-144c8791-f021-4294-bb0e-d344894642f9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:18.443905 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-144c8791-f021-4294-bb0e-d344894642f9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:18.445759 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-144c8791-f021-4294-bb0e-d344894642f9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:18.446393 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-144c8791-f021-4294-bb0e-d344894642f9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:18.446837 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-144c8791-f021-4294-bb0e-d344894642f9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:18.450518 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-78bec1e6-555d-4b41-902d-d89b2a37f925 req-bfdeb69f-eb1e-45fd-bfb3-7eed9007bc3e service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:18.452401 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-78bec1e6-555d-4b41-902d-d89b2a37f925 req-bfdeb69f-eb1e-45fd-bfb3-7eed9007bc3e service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:18.453116 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-78bec1e6-555d-4b41-902d-d89b2a37f925 req-bfdeb69f-eb1e-45fd-bfb3-7eed9007bc3e service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:18.470430 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-78bec1e6-555d-4b41-902d-d89b2a37f925 req-bfdeb69f-eb1e-45fd-bfb3-7eed9007bc3e service nova] Creating event network-changed:dc2ec8af-df9c-48b9-af2f-f3d087bf0f93 for instance f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a on hv-cinder-78481 Aug 12 01:32:18.475666 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-78bec1e6-555d-4b41-902d-d89b2a37f925 req-bfdeb69f-eb1e-45fd-bfb3-7eed9007bc3e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051642 Aug 12 01:32:18.476263 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 315/624] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 01:32:18.513423 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-144c8791-f021-4294-bb0e-d344894642f9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:18.521722 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-144c8791-f021-4294-bb0e-d344894642f9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:18.523219 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-144c8791-f021-4294-bb0e-d344894642f9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:18.524365 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-144c8791-f021-4294-bb0e-d344894642f9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1340 microversion: 2.20 time: 0.117771 Aug 12 01:32:18.524896 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 310/625] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:32:18 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1340 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:32:18.983193 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-caef0ae7-3589-4276-a92e-111aef2747ab tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:18.984032 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-caef0ae7-3589-4276-a92e-111aef2747ab tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:18.991014 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-caef0ae7-3589-4276-a92e-111aef2747ab tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:18.991500 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-caef0ae7-3589-4276-a92e-111aef2747ab tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:18.991952 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-caef0ae7-3589-4276-a92e-111aef2747ab tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:18.992878 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-caef0ae7-3589-4276-a92e-111aef2747ab tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:18.993408 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-caef0ae7-3589-4276-a92e-111aef2747ab tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:18.994874 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-caef0ae7-3589-4276-a92e-111aef2747ab tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:19.037525 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-caef0ae7-3589-4276-a92e-111aef2747ab tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:19.038276 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-caef0ae7-3589-4276-a92e-111aef2747ab tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:19.039096 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-caef0ae7-3589-4276-a92e-111aef2747ab tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:19.039741 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.objects.instance [None req-caef0ae7-3589-4276-a92e-111aef2747ab tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lazy-loading 'fault' on Instance uuid 32538820-dcc6-45ce-9b8b-dea8fe7e4776 {{(pid=120786) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 01:32:19.183960 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-caef0ae7-3589-4276-a92e-111aef2747ab tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15481d01cf6d4c67af858859f74a1607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '135531dcbc244552aef21e5d555da3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:19.195322 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-caef0ae7-3589-4276-a92e-111aef2747ab tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 200 len: 1349 microversion: 2.1 time: 0.216651 Aug 12 01:32:19.196531 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 316/626] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:18 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 1349 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:32:19.548443 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-26e888ab-ba60-4f8a-a518-d6177442eebb tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:19.550675 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-26e888ab-ba60-4f8a-a518-d6177442eebb tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:19.572982 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-26e888ab-ba60-4f8a-a518-d6177442eebb tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:19.573728 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-26e888ab-ba60-4f8a-a518-d6177442eebb tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:19.575723 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-26e888ab-ba60-4f8a-a518-d6177442eebb tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:19.576815 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-26e888ab-ba60-4f8a-a518-d6177442eebb tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:19.578041 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-26e888ab-ba60-4f8a-a518-d6177442eebb tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:19.578851 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-26e888ab-ba60-4f8a-a518-d6177442eebb tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:19.732656 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-26e888ab-ba60-4f8a-a518-d6177442eebb tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:19.741546 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-26e888ab-ba60-4f8a-a518-d6177442eebb tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:19.743148 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-26e888ab-ba60-4f8a-a518-d6177442eebb tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:19.744439 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-26e888ab-ba60-4f8a-a518-d6177442eebb tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1407 microversion: 2.20 time: 0.201865 Aug 12 01:32:19.745104 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 311/627] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:32:19 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:32:20.217714 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-dd97ca5e-8d50-435c-81a5-46f1ec9b26ad tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:20.218344 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-dd97ca5e-8d50-435c-81a5-46f1ec9b26ad tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] [instance: 32538820-dcc6-45ce-9b8b-dea8fe7e4776] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:20.224913 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dd97ca5e-8d50-435c-81a5-46f1ec9b26ad tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:20.225242 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dd97ca5e-8d50-435c-81a5-46f1ec9b26ad tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:20.225682 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dd97ca5e-8d50-435c-81a5-46f1ec9b26ad tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:20.226388 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dd97ca5e-8d50-435c-81a5-46f1ec9b26ad tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:20.226895 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dd97ca5e-8d50-435c-81a5-46f1ec9b26ad tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:20.227260 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dd97ca5e-8d50-435c-81a5-46f1ec9b26ad tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:20.238827 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-c3b70421-4213-4aa2-93b9-8e8b9f89395b req-ea6178e7-c21c-4630-8e27-ffc72abfc49a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3d50f7a-89e5-4250-be37-7fdf4f9b79da", "tag": "a7da4e13-3cc9-4eeb-9f82-064424d0880e"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:32:20.243129 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.wsgi [None req-dd97ca5e-8d50-435c-81a5-46f1ec9b26ad tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] HTTP exception thrown: Instance 32538820-dcc6-45ce-9b8b-dea8fe7e4776 could not be found. Aug 12 01:32:20.244910 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-dd97ca5e-8d50-435c-81a5-46f1ec9b26ad tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Request method failure captured: Aug 12 01:32:20.244910 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: request: GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 HTTP/1.1 Aug 12 01:32:20.244910 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept: application/json Aug 12 01:32:20.244910 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept-Encoding: identity Aug 12 01:32:20.244910 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Connection: close Aug 12 01:32:20.244910 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Length: 0 Aug 12 01:32:20.244910 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Type: application/json Aug 12 01:32:20.244910 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Host: 10.222.0.20 Aug 12 01:32:20.244910 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Openstack-System-Scope: None Aug 12 01:32:20.244910 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: User-Agent: python-urllib3/1.26.11 Aug 12 01:32:20.244910 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Auth-Token: gAAAAABi9azhfqoNTrPPk348_iOHTVdfn-VxkfW7u6wyx4zoggmSpMqI9FGC6vJCyYanjiEwiW_rL5_sSRjP72wNlgSmiHrxckzJd3w0OTpEEUr0qCCzNaIP9r99SqAaCBi3O7crgG2yWyLdhI81I9L9XaMh2puueaplq1MUdgDSW0bQXrcVOHQ Aug 12 01:32:20.244910 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Id: None Aug 12 01:32:20.244910 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Name: None Aug 12 01:32:20.244910 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Identity-Status: Confirmed Aug 12 01:32:20.244910 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Is-Admin-Project: True Aug 12 01:32:20.244910 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Id: default Aug 12 01:32:20.244910 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Name: Default Aug 12 01:32:20.244910 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Id: 135531dcbc244552aef21e5d555da3c4 Aug 12 01:32:20.244910 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Name: tempest-TestMinimumBasicScenario-1914149486 Aug 12 01:32:20.244910 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Role: member,reader Aug 12 01:32:20.244910 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Roles: member,reader Aug 12 01:32:20.246736 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/135531dcbc244552aef21e5d555da3c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/135531dcbc244552aef21e5d555da3c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_135531dcbc244552aef21e5d555da3c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/135531dcbc244552aef21e5d555da3c4"}]}] Aug 12 01:32:20.246736 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant: tempest-TestMinimumBasicScenario-1914149486 Aug 12 01:32:20.246736 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Id: 135531dcbc244552aef21e5d555da3c4 Aug 12 01:32:20.246736 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1914149486 Aug 12 01:32:20.246736 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User: tempest-TestMinimumBasicScenario-1914149486-project Aug 12 01:32:20.246736 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Id: default Aug 12 01:32:20.246736 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Name: Default Aug 12 01:32:20.246736 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Id: 15481d01cf6d4c67af858859f74a1607 Aug 12 01:32:20.246736 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Name: tempest-TestMinimumBasicScenario-1914149486-project Aug 12 01:32:20.246736 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: method: > Aug 12 01:32:20.246736 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: exception: Instance 32538820-dcc6-45ce-9b8b-dea8fe7e4776 could not be found. Aug 12 01:32:20.246736 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: action_args: {'id': '32538820-dcc6-45ce-9b8b-dea8fe7e4776'} Aug 12 01:32:20.247817 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:32:20.247817 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:32:20.247817 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:32:20.247817 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:32:20.247817 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:32:20.247817 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:32:20.247817 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:32:20.247817 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:32:20.247817 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:32:20.247817 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:32:20.247817 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32538820-dcc6-45ce-9b8b-dea8fe7e4776 could not be found. Aug 12 01:32:20.247817 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:32:20.247817 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:32:20.247817 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:32:20.247817 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:32:20.247817 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:32:20.247817 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:32:20.247817 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:32:20.247817 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:32:20.247817 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:32:20.249832 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:32:20.249832 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 01:32:20.249832 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 01:32:20.249832 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:32:20.249832 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:32:20.249832 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:32:20.249832 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:32:20.249832 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32538820-dcc6-45ce-9b8b-dea8fe7e4776 could not be found. Aug 12 01:32:20.249832 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:32:20.249832 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:32:20.249832 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:32:20.249832 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:32:20.249832 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:32:20.249832 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:32:20.249832 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:32:20.249832 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:32:20.249832 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32538820-dcc6-45ce-9b8b-dea8fe7e4776 could not be found. Aug 12 01:32:20.249832 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:32:20.251436 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-dd97ca5e-8d50-435c-81a5-46f1ec9b26ad tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Returning 404 to user: Instance 32538820-dcc6-45ce-9b8b-dea8fe7e4776 could not be found. {{(pid=120786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:32:20.251436 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-dd97ca5e-8d50-435c-81a5-46f1ec9b26ad tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776" status: 404 len: 111 microversion: 2.1 time: 0.033475 Aug 12 01:32:20.251436 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 317/628] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:20 2022] GET /compute/v2.1/servers/32538820-dcc6-45ce-9b8b-dea8fe7e4776 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:32:20.255684 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-10d96f85-a4ad-4cbd-9efe-62c738794a95 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] Calling method '.version_select at 0x7f2decea1e50>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:20.260283 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-c3b70421-4213-4aa2-93b9-8e8b9f89395b req-ea6178e7-c21c-4630-8e27-ffc72abfc49a service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:20.261573 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-c3b70421-4213-4aa2-93b9-8e8b9f89395b req-ea6178e7-c21c-4630-8e27-ffc72abfc49a service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:20.263413 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-c3b70421-4213-4aa2-93b9-8e8b9f89395b req-ea6178e7-c21c-4630-8e27-ffc72abfc49a service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:20.276879 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-10d96f85-a4ad-4cbd-9efe-62c738794a95 tempest-TestMinimumBasicScenario-1914149486 tempest-TestMinimumBasicScenario-1914149486-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1851288918" status: 202 len: 0 microversion: 2.1 time: 0.025251 Aug 12 01:32:20.277453 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 318/629] 10.222.0.20 () {58 vars in 1272 bytes} [Fri Aug 12 01:32:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1851288918 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 12 01:32:20.280683 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-c3b70421-4213-4aa2-93b9-8e8b9f89395b req-ea6178e7-c21c-4630-8e27-ffc72abfc49a service nova] Creating event network-changed:a7da4e13-3cc9-4eeb-9f82-064424d0880e for instance f3d50f7a-89e5-4250-be37-7fdf4f9b79da on hv-cinder-78481 Aug 12 01:32:20.284587 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-c3b70421-4213-4aa2-93b9-8e8b9f89395b req-ea6178e7-c21c-4630-8e27-ffc72abfc49a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050970 Aug 12 01:32:20.285520 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 312/630] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:32:20.491365 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-6d6c5aa5-ef5e-4d17-a1a3-296d96f2d1d5 req-116366db-4572-4eae-b5b6-1bcaa40e994d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a", "tag": "dc2ec8af-df9c-48b9-af2f-f3d087bf0f93"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:32:20.502541 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-6d6c5aa5-ef5e-4d17-a1a3-296d96f2d1d5 req-116366db-4572-4eae-b5b6-1bcaa40e994d service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:20.503107 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-6d6c5aa5-ef5e-4d17-a1a3-296d96f2d1d5 req-116366db-4572-4eae-b5b6-1bcaa40e994d service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:20.504235 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-6d6c5aa5-ef5e-4d17-a1a3-296d96f2d1d5 req-116366db-4572-4eae-b5b6-1bcaa40e994d service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:20.524684 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-6d6c5aa5-ef5e-4d17-a1a3-296d96f2d1d5 req-116366db-4572-4eae-b5b6-1bcaa40e994d service nova] Creating event network-changed:dc2ec8af-df9c-48b9-af2f-f3d087bf0f93 for instance f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a on hv-cinder-78481 Aug 12 01:32:20.530994 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-6d6c5aa5-ef5e-4d17-a1a3-296d96f2d1d5 req-116366db-4572-4eae-b5b6-1bcaa40e994d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044481 Aug 12 01:32:20.531712 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 319/631] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:32:20.767860 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-74333127-aa40-47c8-bae9-961310a26666 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:20.768662 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-74333127-aa40-47c8-bae9-961310a26666 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:20.775644 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-74333127-aa40-47c8-bae9-961310a26666 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:20.776118 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-74333127-aa40-47c8-bae9-961310a26666 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:20.776545 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-74333127-aa40-47c8-bae9-961310a26666 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:20.777245 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-74333127-aa40-47c8-bae9-961310a26666 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:20.777698 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-74333127-aa40-47c8-bae9-961310a26666 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:20.778112 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-74333127-aa40-47c8-bae9-961310a26666 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:20.909009 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-74333127-aa40-47c8-bae9-961310a26666 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:20.917552 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-74333127-aa40-47c8-bae9-961310a26666 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:20.919072 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-74333127-aa40-47c8-bae9-961310a26666 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:20.920408 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-74333127-aa40-47c8-bae9-961310a26666 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1407 microversion: 2.20 time: 0.157289 Aug 12 01:32:20.921003 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 313/632] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:32:20 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:32:21.944513 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-b4fbb7d0-89f1-4016-b141-3456a8ad1453 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:21.945209 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-b4fbb7d0-89f1-4016-b141-3456a8ad1453 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:21.951799 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b4fbb7d0-89f1-4016-b141-3456a8ad1453 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:21.952848 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b4fbb7d0-89f1-4016-b141-3456a8ad1453 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:21.953284 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b4fbb7d0-89f1-4016-b141-3456a8ad1453 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:21.953988 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b4fbb7d0-89f1-4016-b141-3456a8ad1453 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:21.954434 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b4fbb7d0-89f1-4016-b141-3456a8ad1453 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:21.954874 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b4fbb7d0-89f1-4016-b141-3456a8ad1453 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:22.119544 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-b4fbb7d0-89f1-4016-b141-3456a8ad1453 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:22.127473 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-b4fbb7d0-89f1-4016-b141-3456a8ad1453 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:22.129038 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-b4fbb7d0-89f1-4016-b141-3456a8ad1453 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:22.130149 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-b4fbb7d0-89f1-4016-b141-3456a8ad1453 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1407 microversion: 2.20 time: 0.190978 Aug 12 01:32:22.130707 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 320/633] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:32:21 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:32:23.156252 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-533e82f2-2b35-45b8-9271-4323bbefcd51 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:23.156894 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-533e82f2-2b35-45b8-9271-4323bbefcd51 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:23.165866 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-533e82f2-2b35-45b8-9271-4323bbefcd51 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:23.166610 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-533e82f2-2b35-45b8-9271-4323bbefcd51 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:23.167205 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-533e82f2-2b35-45b8-9271-4323bbefcd51 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:23.168113 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-533e82f2-2b35-45b8-9271-4323bbefcd51 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:23.168718 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-533e82f2-2b35-45b8-9271-4323bbefcd51 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:23.169292 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-533e82f2-2b35-45b8-9271-4323bbefcd51 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:23.308164 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-533e82f2-2b35-45b8-9271-4323bbefcd51 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:23.316829 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-533e82f2-2b35-45b8-9271-4323bbefcd51 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:23.318338 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-533e82f2-2b35-45b8-9271-4323bbefcd51 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:23.319466 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-533e82f2-2b35-45b8-9271-4323bbefcd51 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1407 microversion: 2.20 time: 0.171180 Aug 12 01:32:23.320066 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 314/634] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:32:23 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:32:24.342934 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-a430057e-70b2-4ffa-87da-bef9b377603f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:24.343448 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-a430057e-70b2-4ffa-87da-bef9b377603f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:24.348912 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a430057e-70b2-4ffa-87da-bef9b377603f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:24.349389 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a430057e-70b2-4ffa-87da-bef9b377603f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:24.349812 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a430057e-70b2-4ffa-87da-bef9b377603f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:24.350692 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a430057e-70b2-4ffa-87da-bef9b377603f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:24.351139 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a430057e-70b2-4ffa-87da-bef9b377603f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:24.351577 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a430057e-70b2-4ffa-87da-bef9b377603f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:24.570018 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-a430057e-70b2-4ffa-87da-bef9b377603f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:24.578359 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-a430057e-70b2-4ffa-87da-bef9b377603f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:24.579802 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-a430057e-70b2-4ffa-87da-bef9b377603f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:24.580918 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-a430057e-70b2-4ffa-87da-bef9b377603f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1407 microversion: 2.20 time: 0.243172 Aug 12 01:32:24.581473 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 321/635] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:32:24 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:32:24.811476 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-f4a4c803-810b-4e2c-937b-d3ca73849551 req-d8c13f2d-7779-478c-b219-57f7f5b68b0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3d50f7a-89e5-4250-be37-7fdf4f9b79da", "name": "network-vif-plugged", "status": "completed", "tag": "a7da4e13-3cc9-4eeb-9f82-064424d0880e"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:32:24.821303 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-f4a4c803-810b-4e2c-937b-d3ca73849551 req-d8c13f2d-7779-478c-b219-57f7f5b68b0a service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:24.822036 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-f4a4c803-810b-4e2c-937b-d3ca73849551 req-d8c13f2d-7779-478c-b219-57f7f5b68b0a service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:24.822692 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-f4a4c803-810b-4e2c-937b-d3ca73849551 req-d8c13f2d-7779-478c-b219-57f7f5b68b0a service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:24.835445 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-f4a4c803-810b-4e2c-937b-d3ca73849551 req-d8c13f2d-7779-478c-b219-57f7f5b68b0a service nova] Creating event network-vif-plugged:a7da4e13-3cc9-4eeb-9f82-064424d0880e for instance f3d50f7a-89e5-4250-be37-7fdf4f9b79da on hv-cinder-78481 Aug 12 01:32:24.840743 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-f4a4c803-810b-4e2c-937b-d3ca73849551 req-d8c13f2d-7779-478c-b219-57f7f5b68b0a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033472 Aug 12 01:32:24.841422 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 315/636] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:32:25.602509 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-dd91ff05-a6af-4aa2-9e8c-f58745917032 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:25.603100 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-dd91ff05-a6af-4aa2-9e8c-f58745917032 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:25.605090 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell0:SELECT=2 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:25.605745 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell0:SELECT=10 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:25.615944 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dd91ff05-a6af-4aa2-9e8c-f58745917032 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:25.616430 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dd91ff05-a6af-4aa2-9e8c-f58745917032 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:25.617040 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dd91ff05-a6af-4aa2-9e8c-f58745917032 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:25.617740 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dd91ff05-a6af-4aa2-9e8c-f58745917032 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:25.618179 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dd91ff05-a6af-4aa2-9e8c-f58745917032 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:25.618597 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dd91ff05-a6af-4aa2-9e8c-f58745917032 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:25.751206 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-dd91ff05-a6af-4aa2-9e8c-f58745917032 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:25.759443 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-dd91ff05-a6af-4aa2-9e8c-f58745917032 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:25.761034 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-dd91ff05-a6af-4aa2-9e8c-f58745917032 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:25.762133 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-dd91ff05-a6af-4aa2-9e8c-f58745917032 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1407 microversion: 2.20 time: 0.163626 Aug 12 01:32:25.762667 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 322/637] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:32:25 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:32:26.782348 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell0:SELECT=2 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:26.787614 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-eedfd6ea-13a9-4cbb-8580-be41b57e1828 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:26.788320 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-eedfd6ea-13a9-4cbb-8580-be41b57e1828 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:26.795049 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-eedfd6ea-13a9-4cbb-8580-be41b57e1828 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:26.795545 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-eedfd6ea-13a9-4cbb-8580-be41b57e1828 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:26.795980 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-eedfd6ea-13a9-4cbb-8580-be41b57e1828 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:26.796672 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-eedfd6ea-13a9-4cbb-8580-be41b57e1828 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:26.797181 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-eedfd6ea-13a9-4cbb-8580-be41b57e1828 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:26.797724 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-eedfd6ea-13a9-4cbb-8580-be41b57e1828 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:26.945004 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-eedfd6ea-13a9-4cbb-8580-be41b57e1828 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:26.953168 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-eedfd6ea-13a9-4cbb-8580-be41b57e1828 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:26.954702 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-eedfd6ea-13a9-4cbb-8580-be41b57e1828 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:26.955890 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-eedfd6ea-13a9-4cbb-8580-be41b57e1828 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1599 microversion: 2.20 time: 0.174545 Aug 12 01:32:26.956454 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 316/638] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:32:26 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1599 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:32:26.978543 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-f63465c7-3e86-4192-a795-e3eaed8a7bd7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:26.979039 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-f63465c7-3e86-4192-a795-e3eaed8a7bd7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:26.986602 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f63465c7-3e86-4192-a795-e3eaed8a7bd7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:26.987119 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f63465c7-3e86-4192-a795-e3eaed8a7bd7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:26.987578 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f63465c7-3e86-4192-a795-e3eaed8a7bd7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:26.988277 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f63465c7-3e86-4192-a795-e3eaed8a7bd7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:26.988727 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f63465c7-3e86-4192-a795-e3eaed8a7bd7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:26.989153 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f63465c7-3e86-4192-a795-e3eaed8a7bd7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:27.093236 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-f63465c7-3e86-4192-a795-e3eaed8a7bd7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.118558 Aug 12 01:32:27.094071 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 323/639] 10.222.0.20 () {60 vars in 1316 bytes} [Fri Aug 12 01:32:26 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 01:32:28.360442 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-c5cee7ae-5e47-4deb-a53f-b69e07354eb4 req-cf0ecf39-b3ed-4ed9-9db3-9f8d1343e8f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3d50f7a-89e5-4250-be37-7fdf4f9b79da", "tag": "a7da4e13-3cc9-4eeb-9f82-064424d0880e"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:32:28.371141 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-c5cee7ae-5e47-4deb-a53f-b69e07354eb4 req-cf0ecf39-b3ed-4ed9-9db3-9f8d1343e8f2 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:28.371689 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-c5cee7ae-5e47-4deb-a53f-b69e07354eb4 req-cf0ecf39-b3ed-4ed9-9db3-9f8d1343e8f2 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:28.372121 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-c5cee7ae-5e47-4deb-a53f-b69e07354eb4 req-cf0ecf39-b3ed-4ed9-9db3-9f8d1343e8f2 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:28.385930 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-c5cee7ae-5e47-4deb-a53f-b69e07354eb4 req-cf0ecf39-b3ed-4ed9-9db3-9f8d1343e8f2 service nova] Creating event network-changed:a7da4e13-3cc9-4eeb-9f82-064424d0880e for instance f3d50f7a-89e5-4250-be37-7fdf4f9b79da on hv-cinder-78481 Aug 12 01:32:28.391258 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-c5cee7ae-5e47-4deb-a53f-b69e07354eb4 req-cf0ecf39-b3ed-4ed9-9db3-9f8d1343e8f2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037479 Aug 12 01:32:28.394933 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 317/640] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:32:44.180487 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=76,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:44.181686 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:44.187633 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-8344762e-9033-4209-9da2-c1d00464d04a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:44.191029 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-8344762e-9033-4209-9da2-c1d00464d04a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:44.201913 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8344762e-9033-4209-9da2-c1d00464d04a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:44.202397 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8344762e-9033-4209-9da2-c1d00464d04a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:44.202830 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8344762e-9033-4209-9da2-c1d00464d04a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:44.203515 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8344762e-9033-4209-9da2-c1d00464d04a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:44.203989 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8344762e-9033-4209-9da2-c1d00464d04a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:44.204409 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8344762e-9033-4209-9da2-c1d00464d04a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:44.234515 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-8344762e-9033-4209-9da2-c1d00464d04a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057038 Aug 12 01:32:44.235068 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 324/641] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 01:32:44 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 01:32:44.300220 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:44.300963 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=1 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:44.305428 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-104ae2b8-dec4-4dae-bb7c-4a2f89711097 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:44.306010 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-104ae2b8-dec4-4dae-bb7c-4a2f89711097 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:44.314296 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-104ae2b8-dec4-4dae-bb7c-4a2f89711097 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:44.314768 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-104ae2b8-dec4-4dae-bb7c-4a2f89711097 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:44.315207 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-104ae2b8-dec4-4dae-bb7c-4a2f89711097 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:44.315927 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-104ae2b8-dec4-4dae-bb7c-4a2f89711097 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:44.316381 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-104ae2b8-dec4-4dae-bb7c-4a2f89711097 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:44.316806 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-104ae2b8-dec4-4dae-bb7c-4a2f89711097 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:44.342650 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-104ae2b8-dec4-4dae-bb7c-4a2f89711097 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Going to try to terminate instance {{(pid=120785) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 01:32:44.417099 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-104ae2b8-dec4-4dae-bb7c-4a2f89711097 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 204 len: 0 microversion: 2.1 time: 0.118113 Aug 12 01:32:44.417933 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 318/642] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 01:32:44 2022] DELETE /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 01:32:44.427087 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-6208a3bd-c59b-4257-9310-4aa049a6b0ea tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:44.427782 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-6208a3bd-c59b-4257-9310-4aa049a6b0ea tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:44.436379 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6208a3bd-c59b-4257-9310-4aa049a6b0ea tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:44.436847 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6208a3bd-c59b-4257-9310-4aa049a6b0ea tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:44.437477 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6208a3bd-c59b-4257-9310-4aa049a6b0ea tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:44.438380 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6208a3bd-c59b-4257-9310-4aa049a6b0ea tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:44.438831 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6208a3bd-c59b-4257-9310-4aa049a6b0ea tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:44.439254 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6208a3bd-c59b-4257-9310-4aa049a6b0ea tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:44.571074 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-6208a3bd-c59b-4257-9310-4aa049a6b0ea tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:44.583793 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-6208a3bd-c59b-4257-9310-4aa049a6b0ea tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1671 microversion: 2.1 time: 0.160904 Aug 12 01:32:44.584639 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 325/643] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:44 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:32:45.612045 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-a127c36a-d436-4d41-85b2-b54934ab9079 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:45.613097 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-a127c36a-d436-4d41-85b2-b54934ab9079 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:45.623511 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a127c36a-d436-4d41-85b2-b54934ab9079 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:45.624018 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a127c36a-d436-4d41-85b2-b54934ab9079 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:45.624471 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a127c36a-d436-4d41-85b2-b54934ab9079 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:45.625166 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a127c36a-d436-4d41-85b2-b54934ab9079 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:45.625613 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a127c36a-d436-4d41-85b2-b54934ab9079 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:45.626031 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a127c36a-d436-4d41-85b2-b54934ab9079 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:45.765076 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-a127c36a-d436-4d41-85b2-b54934ab9079 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:45.773014 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-a127c36a-d436-4d41-85b2-b54934ab9079 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1671 microversion: 2.1 time: 0.168167 Aug 12 01:32:45.773584 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 319/644] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:45 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1671 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:32:46.793918 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-45d40162-198b-4d6f-8f9d-3b80d7a87443 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:46.794587 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-45d40162-198b-4d6f-8f9d-3b80d7a87443 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:46.801351 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-45d40162-198b-4d6f-8f9d-3b80d7a87443 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:46.801840 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-45d40162-198b-4d6f-8f9d-3b80d7a87443 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:46.802267 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-45d40162-198b-4d6f-8f9d-3b80d7a87443 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:46.802955 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-45d40162-198b-4d6f-8f9d-3b80d7a87443 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:46.803749 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-45d40162-198b-4d6f-8f9d-3b80d7a87443 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:46.804187 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-45d40162-198b-4d6f-8f9d-3b80d7a87443 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:46.934435 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-45d40162-198b-4d6f-8f9d-3b80d7a87443 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:46.942661 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-45d40162-198b-4d6f-8f9d-3b80d7a87443 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1671 microversion: 2.1 time: 0.152660 Aug 12 01:32:46.943278 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 326/645] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:46 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:32:47.564734 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-eb0bd1f9-ab52-450b-89e9-0f41b29572d0 req-ffbe6017-3a23-4c33-925c-4c3b178f1e24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4364ac0-a9b7-4650-8456-15ccdd39bc3a", "name": "network-vif-deleted", "tag": "4e439648-a2fe-49f9-a809-a2ad4090be7d"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:32:47.575916 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-eb0bd1f9-ab52-450b-89e9-0f41b29572d0 req-ffbe6017-3a23-4c33-925c-4c3b178f1e24 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:47.576391 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-eb0bd1f9-ab52-450b-89e9-0f41b29572d0 req-ffbe6017-3a23-4c33-925c-4c3b178f1e24 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:47.576814 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-eb0bd1f9-ab52-450b-89e9-0f41b29572d0 req-ffbe6017-3a23-4c33-925c-4c3b178f1e24 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:47.589820 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-eb0bd1f9-ab52-450b-89e9-0f41b29572d0 req-ffbe6017-3a23-4c33-925c-4c3b178f1e24 service nova] Creating event network-vif-deleted:4e439648-a2fe-49f9-a809-a2ad4090be7d for instance c4364ac0-a9b7-4650-8456-15ccdd39bc3a on hv-cinder-78481 Aug 12 01:32:47.595112 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-eb0bd1f9-ab52-450b-89e9-0f41b29572d0 req-ffbe6017-3a23-4c33-925c-4c3b178f1e24 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034405 Aug 12 01:32:47.596075 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 320/646] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:32:47.964648 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-55c41a6a-b329-43cf-b2af-b02ef5f4f6a7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:47.965548 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-55c41a6a-b329-43cf-b2af-b02ef5f4f6a7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:47.973410 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-55c41a6a-b329-43cf-b2af-b02ef5f4f6a7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:47.973895 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-55c41a6a-b329-43cf-b2af-b02ef5f4f6a7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:47.974318 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-55c41a6a-b329-43cf-b2af-b02ef5f4f6a7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:47.975004 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-55c41a6a-b329-43cf-b2af-b02ef5f4f6a7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:47.975623 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-55c41a6a-b329-43cf-b2af-b02ef5f4f6a7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:47.976046 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-55c41a6a-b329-43cf-b2af-b02ef5f4f6a7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:48.008594 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-55c41a6a-b329-43cf-b2af-b02ef5f4f6a7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:48.009076 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-55c41a6a-b329-43cf-b2af-b02ef5f4f6a7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:48.009502 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-55c41a6a-b329-43cf-b2af-b02ef5f4f6a7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:48.010284 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.objects.instance [None req-55c41a6a-b329-43cf-b2af-b02ef5f4f6a7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lazy-loading 'fault' on Instance uuid c4364ac0-a9b7-4650-8456-15ccdd39bc3a {{(pid=120786) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 01:32:48.052347 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-55c41a6a-b329-43cf-b2af-b02ef5f4f6a7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:48.061755 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-55c41a6a-b329-43cf-b2af-b02ef5f4f6a7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 200 len: 1326 microversion: 2.1 time: 0.100968 Aug 12 01:32:48.062350 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 327/647] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:47 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 1326 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:32:49.091440 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-46e51ee9-3b24-47e6-86b4-1786863f2162 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:49.092708 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-46e51ee9-3b24-47e6-86b4-1786863f2162 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:49.099668 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-46e51ee9-3b24-47e6-86b4-1786863f2162 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:49.100153 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-46e51ee9-3b24-47e6-86b4-1786863f2162 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:49.100590 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-46e51ee9-3b24-47e6-86b4-1786863f2162 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:49.101287 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-46e51ee9-3b24-47e6-86b4-1786863f2162 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:49.101737 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-46e51ee9-3b24-47e6-86b4-1786863f2162 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:49.102160 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-46e51ee9-3b24-47e6-86b4-1786863f2162 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:49.115847 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.wsgi [None req-46e51ee9-3b24-47e6-86b4-1786863f2162 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] HTTP exception thrown: Instance c4364ac0-a9b7-4650-8456-15ccdd39bc3a could not be found. Aug 12 01:32:49.117487 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-46e51ee9-3b24-47e6-86b4-1786863f2162 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Request method failure captured: Aug 12 01:32:49.117487 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: request: GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a HTTP/1.1 Aug 12 01:32:49.117487 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept: application/json Aug 12 01:32:49.117487 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept-Encoding: identity Aug 12 01:32:49.117487 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Connection: close Aug 12 01:32:49.117487 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Length: 0 Aug 12 01:32:49.117487 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Type: application/json Aug 12 01:32:49.117487 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Host: 10.222.0.20 Aug 12 01:32:49.117487 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Openstack-System-Scope: None Aug 12 01:32:49.117487 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: User-Agent: python-urllib3/1.26.11 Aug 12 01:32:49.117487 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Auth-Token: gAAAAABi9ayskh2QdkEN5AsDjgVGNCXEoYZB0mwI3UKbkhVB-xgOT7ahyRjRMHIM6lPE15MPlDJhYjTUgsjx8wgW2blzPFOHnB1Cl4V5skiuQt2vjs7BmFNk8l8MeY2vdlIJArTl_MMJVkV0P8Cj7dMTnnGQmjZ8u3WuHUiEXmTSSa0aqTBvkSA Aug 12 01:32:49.117487 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Id: None Aug 12 01:32:49.117487 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Name: None Aug 12 01:32:49.117487 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Identity-Status: Confirmed Aug 12 01:32:49.117487 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Is-Admin-Project: True Aug 12 01:32:49.117487 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Id: default Aug 12 01:32:49.117487 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Name: Default Aug 12 01:32:49.117487 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Id: 0cb834d06ed94c1993ec0f7130d97803 Aug 12 01:32:49.117487 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Name: tempest-AttachVolumeTestJSON-275393966 Aug 12 01:32:49.117487 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Role: member,reader Aug 12 01:32:49.117487 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Roles: member,reader Aug 12 01:32:49.118955 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0cb834d06ed94c1993ec0f7130d97803"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0cb834d06ed94c1993ec0f7130d97803"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0cb834d06ed94c1993ec0f7130d97803"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0cb834d06ed94c1993ec0f7130d97803"}]}] Aug 12 01:32:49.118955 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant: tempest-AttachVolumeTestJSON-275393966 Aug 12 01:32:49.118955 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Id: 0cb834d06ed94c1993ec0f7130d97803 Aug 12 01:32:49.118955 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Name: tempest-AttachVolumeTestJSON-275393966 Aug 12 01:32:49.118955 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User: tempest-AttachVolumeTestJSON-275393966-project Aug 12 01:32:49.118955 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Id: default Aug 12 01:32:49.118955 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Name: Default Aug 12 01:32:49.118955 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Id: 605b0b202a3b44c7aa227c1b97193365 Aug 12 01:32:49.118955 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Name: tempest-AttachVolumeTestJSON-275393966-project Aug 12 01:32:49.118955 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: method: > Aug 12 01:32:49.118955 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: exception: Instance c4364ac0-a9b7-4650-8456-15ccdd39bc3a could not be found. Aug 12 01:32:49.118955 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: action_args: {'id': 'c4364ac0-a9b7-4650-8456-15ccdd39bc3a'} Aug 12 01:32:49.119769 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:32:49.119769 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:32:49.119769 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:32:49.119769 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:32:49.119769 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:32:49.119769 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:32:49.119769 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:32:49.119769 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:32:49.119769 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:32:49.119769 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:32:49.119769 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4364ac0-a9b7-4650-8456-15ccdd39bc3a could not be found. Aug 12 01:32:49.119769 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:32:49.119769 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:32:49.119769 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:32:49.119769 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:32:49.119769 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:32:49.119769 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:32:49.119769 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:32:49.119769 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:32:49.119769 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:32:49.120998 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:32:49.120998 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 01:32:49.120998 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 01:32:49.120998 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:32:49.120998 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:32:49.120998 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:32:49.120998 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:32:49.120998 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4364ac0-a9b7-4650-8456-15ccdd39bc3a could not be found. Aug 12 01:32:49.120998 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:32:49.120998 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:32:49.120998 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:32:49.120998 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:32:49.120998 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:32:49.120998 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:32:49.120998 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:32:49.120998 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:32:49.120998 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4364ac0-a9b7-4650-8456-15ccdd39bc3a could not be found. Aug 12 01:32:49.120998 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:32:49.122154 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-46e51ee9-3b24-47e6-86b4-1786863f2162 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Returning 404 to user: Instance c4364ac0-a9b7-4650-8456-15ccdd39bc3a could not be found. {{(pid=120785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:32:49.122154 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-46e51ee9-3b24-47e6-86b4-1786863f2162 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 404 len: 111 microversion: 2.1 time: 0.035367 Aug 12 01:32:49.122154 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 321/648] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:49 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:32:49.128287 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-c3a52162-237c-4be5-ae71-3774cfb54432 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '.version_select at 0x7f2decd8be50>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:49.149913 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-c3a52162-237c-4be5-ae71-3774cfb54432 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-788424551" status: 202 len: 0 microversion: 2.1 time: 0.025492 Aug 12 01:32:49.150466 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 328/649] 10.222.0.20 () {58 vars in 1218 bytes} [Fri Aug 12 01:32:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-788424551 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 01:32:49.794737 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-d241ccad-135f-48a6-af70-6da330522caa tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Action: 'create', calling method: .version_select at 0x7f2decda91f0>, body: {"keypair": {"name": "tempest-keypair-1627478485", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOH/ok0bsHYJPA3JWlJL6QhDJfWkc+7JuZlijKqXSf4CL0I34Z4UUJPHWvWLPF7oVn0yVs7/dm7+MV1J8vxIbhFVbRTtxad/5D6T1VVmUooCZsKCq8gmVOUD9v/e6gPeg=="}} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:32:49.811020 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.quota [None req-d241ccad-135f-48a6-af70-6da330522caa tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Getting quotas for project 0cb834d06ed94c1993ec0f7130d97803. Resources: {'key_pairs'} {{(pid=120785) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 01:32:49.816407 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.quota [None req-d241ccad-135f-48a6-af70-6da330522caa tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Getting quotas for user 605b0b202a3b44c7aa227c1b97193365 and project 0cb834d06ed94c1993ec0f7130d97803. Resources: {'key_pairs'} {{(pid=120785) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 01:32:49.842506 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-d241ccad-135f-48a6-af70-6da330522caa tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051700 Aug 12 01:32:49.843177 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 322/650] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Aug 12 01:32:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:32:51.121259 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-2051a24e-d9fd-411a-84bc-0ec35ebf05a7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-176407294", "imageRef": "0d77ae04-91a5-4e2b-8817-72986618c549", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c945ad6e-d04a-40d2-b591-3e29f6e664bb"}], "security_groups": [{"name": "tempest-securitygroup--215228062"}], "key_name": "tempest-keypair-1627478485", "user_data": "}} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:32:51.155467 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-0a19889d-edd1-406a-8f35-92b633b4ce6d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:51.156129 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-0a19889d-edd1-406a-8f35-92b633b4ce6d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 033d7c0c-b5ff-43bb-995d-500a2c087f7d] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:51.163152 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0a19889d-edd1-406a-8f35-92b633b4ce6d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:51.163667 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0a19889d-edd1-406a-8f35-92b633b4ce6d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:51.164098 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0a19889d-edd1-406a-8f35-92b633b4ce6d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:51.164751 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0a19889d-edd1-406a-8f35-92b633b4ce6d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:51.165406 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0a19889d-edd1-406a-8f35-92b633b4ce6d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:51.165830 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0a19889d-edd1-406a-8f35-92b633b4ce6d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:51.189967 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-0a19889d-edd1-406a-8f35-92b633b4ce6d tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d/ips" status: 200 len: 150 microversion: 2.1 time: 0.038993 Aug 12 01:32:51.190539 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 323/651] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Aug 12 01:32:51 2022] GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:32:51.227584 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.network.neutron [None req-2051a24e-d9fd-411a-84bc-0ec35ebf05a7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] validate_networks() for [('c945ad6e-d04a-40d2-b591-3e29f6e664bb', None, None, None, None, None)] {{(pid=120786) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 01:32:51.616935 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-2051a24e-d9fd-411a-84bc-0ec35ebf05a7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Flavor limits 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 01:32:51.617357 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-2051a24e-d9fd-411a-84bc-0ec35ebf05a7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Image limits 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 01:32:51.617851 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-2051a24e-d9fd-411a-84bc-0ec35ebf05a7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Flavor pref 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 01:32:51.618234 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-2051a24e-d9fd-411a-84bc-0ec35ebf05a7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Image pref 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 01:32:51.618635 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-2051a24e-d9fd-411a-84bc-0ec35ebf05a7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 01:32:51.628986 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2051a24e-d9fd-411a-84bc-0ec35ebf05a7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:51.629462 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2051a24e-d9fd-411a-84bc-0ec35ebf05a7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:51.629922 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2051a24e-d9fd-411a-84bc-0ec35ebf05a7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:51.630639 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2051a24e-d9fd-411a-84bc-0ec35ebf05a7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:51.631106 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2051a24e-d9fd-411a-84bc-0ec35ebf05a7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:51.631526 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2051a24e-d9fd-411a-84bc-0ec35ebf05a7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:51.649516 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.quota [None req-2051a24e-d9fd-411a-84bc-0ec35ebf05a7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Getting quotas for project 0cb834d06ed94c1993ec0f7130d97803. Resources: {'cores', 'ram', 'instances'} {{(pid=120786) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 01:32:51.653850 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.quota [None req-2051a24e-d9fd-411a-84bc-0ec35ebf05a7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Getting quotas for user 605b0b202a3b44c7aa227c1b97193365 and project 0cb834d06ed94c1993ec0f7130d97803. Resources: {'cores', 'ram', 'instances'} {{(pid=120786) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 01:32:51.666071 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-2051a24e-d9fd-411a-84bc-0ec35ebf05a7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Going to run 1 instances... {{(pid=120786) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 01:32:51.668361 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-2051a24e-d9fd-411a-84bc-0ec35ebf05a7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: 30c8fb82-5cf9-4388-8481-285e8a09c261] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d77ae04-91a5-4e2b-8817-72986618c549',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120786) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 01:32:51.717423 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-2051a24e-d9fd-411a-84bc-0ec35ebf05a7 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.601752 Aug 12 01:32:51.718311 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 329/652] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 01:32:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 12 01:32:51.729855 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-fbcf34ca-bd00-44f1-8cac-b2d1552db16e tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:51.730567 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-fbcf34ca-bd00-44f1-8cac-b2d1552db16e tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: 30c8fb82-5cf9-4388-8481-285e8a09c261] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:51.790985 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-fbcf34ca-bd00-44f1-8cac-b2d1552db16e tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:51.798934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-fbcf34ca-bd00-44f1-8cac-b2d1552db16e tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261" status: 200 len: 1237 microversion: 2.1 time: 0.073656 Aug 12 01:32:51.799551 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 324/653] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:51 2022] GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261 => generated 1237 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:32:52.533298 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-3110d491-d2c8-447a-86c2-3471ba3c096e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5eebf6c4-7c30-48e0-9a6d-e8e6cd1e6a66"}} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:32:52.535979 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-3110d491-d2c8-447a-86c2-3471ba3c096e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 033d7c0c-b5ff-43bb-995d-500a2c087f7d] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:52.547277 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3110d491-d2c8-447a-86c2-3471ba3c096e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:52.547788 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3110d491-d2c8-447a-86c2-3471ba3c096e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:52.548212 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3110d491-d2c8-447a-86c2-3471ba3c096e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:52.549205 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3110d491-d2c8-447a-86c2-3471ba3c096e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:52.549645 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3110d491-d2c8-447a-86c2-3471ba3c096e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:52.550057 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3110d491-d2c8-447a-86c2-3471ba3c096e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:52.821127 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-b5bd254f-0219-4284-890e-357359906c8d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:52.823957 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-b5bd254f-0219-4284-890e-357359906c8d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: 30c8fb82-5cf9-4388-8481-285e8a09c261] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:52.832885 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b5bd254f-0219-4284-890e-357359906c8d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:52.832885 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b5bd254f-0219-4284-890e-357359906c8d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:52.833065 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b5bd254f-0219-4284-890e-357359906c8d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:52.833936 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b5bd254f-0219-4284-890e-357359906c8d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:52.834747 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b5bd254f-0219-4284-890e-357359906c8d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:52.835060 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b5bd254f-0219-4284-890e-357359906c8d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:52.843391 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-3110d491-d2c8-447a-86c2-3471ba3c096e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "POST /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314686 Aug 12 01:32:52.844728 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 330/654] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Aug 12 01:32:52 2022] POST /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:32:52.914602 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-b5bd254f-0219-4284-890e-357359906c8d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:52.935797 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-b5bd254f-0219-4284-890e-357359906c8d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261" status: 200 len: 1307 microversion: 2.1 time: 0.119631 Aug 12 01:32:52.939581 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 325/655] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:52 2022] GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261 => generated 1307 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:32:53.957648 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-71173255-8bc6-4daa-8c45-62417e762bf0 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:53.958923 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-71173255-8bc6-4daa-8c45-62417e762bf0 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: 30c8fb82-5cf9-4388-8481-285e8a09c261] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:53.965311 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-71173255-8bc6-4daa-8c45-62417e762bf0 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:53.965807 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-71173255-8bc6-4daa-8c45-62417e762bf0 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:53.966273 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-71173255-8bc6-4daa-8c45-62417e762bf0 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:53.967150 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-71173255-8bc6-4daa-8c45-62417e762bf0 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:53.967601 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-71173255-8bc6-4daa-8c45-62417e762bf0 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:53.968268 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-71173255-8bc6-4daa-8c45-62417e762bf0 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:54.098599 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-71173255-8bc6-4daa-8c45-62417e762bf0 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:54.106176 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-71173255-8bc6-4daa-8c45-62417e762bf0 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261" status: 200 len: 1362 microversion: 2.1 time: 0.153553 Aug 12 01:32:54.106817 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 331/656] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:53 2022] GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:32:54.169889 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-f1adfb7b-129b-43bb-b601-7a99bc463e07 req-4ccf217b-5e47-4b04-9698-b54f1a8f198a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30c8fb82-5cf9-4388-8481-285e8a09c261", "tag": "8c964826-a690-4806-b18b-226a035ba086"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:32:54.183085 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-f1adfb7b-129b-43bb-b601-7a99bc463e07 req-4ccf217b-5e47-4b04-9698-b54f1a8f198a service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:54.183696 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-f1adfb7b-129b-43bb-b601-7a99bc463e07 req-4ccf217b-5e47-4b04-9698-b54f1a8f198a service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:54.184214 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-f1adfb7b-129b-43bb-b601-7a99bc463e07 req-4ccf217b-5e47-4b04-9698-b54f1a8f198a service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:54.197199 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-f1adfb7b-129b-43bb-b601-7a99bc463e07 req-4ccf217b-5e47-4b04-9698-b54f1a8f198a service nova] Creating event network-changed:8c964826-a690-4806-b18b-226a035ba086 for instance 30c8fb82-5cf9-4388-8481-285e8a09c261 on hv-cinder-78481 Aug 12 01:32:54.202273 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-f1adfb7b-129b-43bb-b601-7a99bc463e07 req-4ccf217b-5e47-4b04-9698-b54f1a8f198a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036592 Aug 12 01:32:54.203044 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 326/657] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:32:55.130312 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-d0f42efb-ea2f-4c15-a915-d4f3c1c46afa tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:55.130913 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-d0f42efb-ea2f-4c15-a915-d4f3c1c46afa tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: 30c8fb82-5cf9-4388-8481-285e8a09c261] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:55.137669 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d0f42efb-ea2f-4c15-a915-d4f3c1c46afa tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:55.138135 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d0f42efb-ea2f-4c15-a915-d4f3c1c46afa tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:55.138556 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d0f42efb-ea2f-4c15-a915-d4f3c1c46afa tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:55.139231 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d0f42efb-ea2f-4c15-a915-d4f3c1c46afa tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:55.139702 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d0f42efb-ea2f-4c15-a915-d4f3c1c46afa tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:55.140112 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d0f42efb-ea2f-4c15-a915-d4f3c1c46afa tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:55.274890 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-d0f42efb-ea2f-4c15-a915-d4f3c1c46afa tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:55.282741 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-d0f42efb-ea2f-4c15-a915-d4f3c1c46afa tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261" status: 200 len: 1362 microversion: 2.1 time: 0.156923 Aug 12 01:32:55.283390 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 332/658] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:55 2022] GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:32:56.304797 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-3a3a21e8-967a-43b4-9d07-8cacc07b805a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:56.305534 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-3a3a21e8-967a-43b4-9d07-8cacc07b805a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: 30c8fb82-5cf9-4388-8481-285e8a09c261] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:56.312885 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3a3a21e8-967a-43b4-9d07-8cacc07b805a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:56.313361 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3a3a21e8-967a-43b4-9d07-8cacc07b805a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:56.313821 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3a3a21e8-967a-43b4-9d07-8cacc07b805a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:56.314750 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3a3a21e8-967a-43b4-9d07-8cacc07b805a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:56.315200 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3a3a21e8-967a-43b4-9d07-8cacc07b805a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:56.315639 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3a3a21e8-967a-43b4-9d07-8cacc07b805a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:56.626328 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-3a3a21e8-967a-43b4-9d07-8cacc07b805a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:56.634921 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-3a3a21e8-967a-43b4-9d07-8cacc07b805a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261" status: 200 len: 1362 microversion: 2.1 time: 0.334656 Aug 12 01:32:56.635494 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 327/659] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:56 2022] GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261 => generated 1362 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:32:57.437473 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-1f4f033f-fec0-4d2d-ad91-bfcc83bfea3e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:57.437965 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-1f4f033f-fec0-4d2d-ad91-bfcc83bfea3e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:57.444675 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1f4f033f-fec0-4d2d-ad91-bfcc83bfea3e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:57.445156 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1f4f033f-fec0-4d2d-ad91-bfcc83bfea3e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:57.445591 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1f4f033f-fec0-4d2d-ad91-bfcc83bfea3e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:57.446278 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1f4f033f-fec0-4d2d-ad91-bfcc83bfea3e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:57.446723 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1f4f033f-fec0-4d2d-ad91-bfcc83bfea3e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:57.447144 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1f4f033f-fec0-4d2d-ad91-bfcc83bfea3e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:57.631888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.objects.instance [None req-1f4f033f-fec0-4d2d-ad91-bfcc83bfea3e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lazy-loading 'services' on Instance uuid f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a {{(pid=120786) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 01:32:57.655085 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-ab621b25-b596-4b40-a431-e7446bd7832d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:57.655727 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-ab621b25-b596-4b40-a431-e7446bd7832d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: 30c8fb82-5cf9-4388-8481-285e8a09c261] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:57.662281 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ab621b25-b596-4b40-a431-e7446bd7832d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:57.662762 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ab621b25-b596-4b40-a431-e7446bd7832d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:57.663192 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ab621b25-b596-4b40-a431-e7446bd7832d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:57.663915 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ab621b25-b596-4b40-a431-e7446bd7832d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:57.664361 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ab621b25-b596-4b40-a431-e7446bd7832d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:57.664810 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ab621b25-b596-4b40-a431-e7446bd7832d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:57.707178 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-1f4f033f-fec0-4d2d-ad91-bfcc83bfea3e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a/os-volume_attachments/4a46cfd6-f449-4868-930e-d4cd2356ce0c" status: 202 len: 0 microversion: 2.1 time: 0.273489 Aug 12 01:32:57.707969 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 333/660] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Aug 12 01:32:57 2022] DELETE /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a/os-volume_attachments/4a46cfd6-f449-4868-930e-d4cd2356ce0c => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 01:32:57.717796 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-b641fe71-17b9-42c1-b85c-42ebed561706 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:57.720559 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-b641fe71-17b9-42c1-b85c-42ebed561706 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:57.728377 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b641fe71-17b9-42c1-b85c-42ebed561706 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:57.728377 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b641fe71-17b9-42c1-b85c-42ebed561706 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:57.728685 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b641fe71-17b9-42c1-b85c-42ebed561706 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:57.729612 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b641fe71-17b9-42c1-b85c-42ebed561706 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:57.730160 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b641fe71-17b9-42c1-b85c-42ebed561706 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:57.730977 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b641fe71-17b9-42c1-b85c-42ebed561706 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:57.769610 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-b641fe71-17b9-42c1-b85c-42ebed561706 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056162 Aug 12 01:32:57.770212 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 334/661] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 01:32:57 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 01:32:57.814391 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-ab621b25-b596-4b40-a431-e7446bd7832d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:57.822453 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-ab621b25-b596-4b40-a431-e7446bd7832d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261" status: 200 len: 1362 microversion: 2.1 time: 0.171285 Aug 12 01:32:57.823021 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 328/662] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:57 2022] GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:32:58.785105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-b559d58e-f764-422f-88cf-146464a7889f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:58.787265 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-b559d58e-f764-422f-88cf-146464a7889f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:58.793916 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b559d58e-f764-422f-88cf-146464a7889f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:58.794404 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b559d58e-f764-422f-88cf-146464a7889f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:58.794830 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b559d58e-f764-422f-88cf-146464a7889f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:58.795525 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b559d58e-f764-422f-88cf-146464a7889f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:58.795987 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b559d58e-f764-422f-88cf-146464a7889f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:58.796409 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b559d58e-f764-422f-88cf-146464a7889f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:58.825621 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-b559d58e-f764-422f-88cf-146464a7889f tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046144 Aug 12 01:32:58.826156 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 335/663] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 01:32:58 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 01:32:58.840721 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-f947f5b5-5708-4176-958d-889d75270fcf tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:58.841261 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-f947f5b5-5708-4176-958d-889d75270fcf tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: a8c75c35-1961-4c9b-9208-ed9096bf447d] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:58.843130 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-81065dfd-8adc-4464-a28a-6fb9a35ce6aa tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:58.843781 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-81065dfd-8adc-4464-a28a-6fb9a35ce6aa tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: 30c8fb82-5cf9-4388-8481-285e8a09c261] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:58.847698 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f947f5b5-5708-4176-958d-889d75270fcf tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:58.848177 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f947f5b5-5708-4176-958d-889d75270fcf tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:58.848739 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f947f5b5-5708-4176-958d-889d75270fcf tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:58.849365 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f947f5b5-5708-4176-958d-889d75270fcf tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:58.849797 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f947f5b5-5708-4176-958d-889d75270fcf tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:58.850134 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-81065dfd-8adc-4464-a28a-6fb9a35ce6aa tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:58.850251 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f947f5b5-5708-4176-958d-889d75270fcf tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:58.850616 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-81065dfd-8adc-4464-a28a-6fb9a35ce6aa tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:58.851045 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-81065dfd-8adc-4464-a28a-6fb9a35ce6aa tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:58.851763 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-81065dfd-8adc-4464-a28a-6fb9a35ce6aa tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:58.852211 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-81065dfd-8adc-4464-a28a-6fb9a35ce6aa tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:58.852715 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-81065dfd-8adc-4464-a28a-6fb9a35ce6aa tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:58.875472 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-f947f5b5-5708-4176-958d-889d75270fcf tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: a8c75c35-1961-4c9b-9208-ed9096bf447d] Going to try to terminate instance {{(pid=120785) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 01:32:58.960225 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-f947f5b5-5708-4176-958d-889d75270fcf tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d" status: 204 len: 0 microversion: 2.1 time: 0.122935 Aug 12 01:32:58.964518 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 329/664] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 01:32:58 2022] DELETE /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 01:32:58.972826 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-423591f6-262f-481d-8afb-81580615c8d1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:58.975049 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-423591f6-262f-481d-8afb-81580615c8d1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: a8c75c35-1961-4c9b-9208-ed9096bf447d] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:58.982889 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-423591f6-262f-481d-8afb-81580615c8d1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:58.983372 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-423591f6-262f-481d-8afb-81580615c8d1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:58.983866 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-423591f6-262f-481d-8afb-81580615c8d1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:58.984555 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-423591f6-262f-481d-8afb-81580615c8d1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:58.985000 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-423591f6-262f-481d-8afb-81580615c8d1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:58.985413 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-423591f6-262f-481d-8afb-81580615c8d1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:59.007929 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-81065dfd-8adc-4464-a28a-6fb9a35ce6aa tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:59.015295 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-81065dfd-8adc-4464-a28a-6fb9a35ce6aa tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261" status: 200 len: 1362 microversion: 2.1 time: 0.175874 Aug 12 01:32:59.015979 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 336/665] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:58 2022] GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:32:59.124620 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-423591f6-262f-481d-8afb-81580615c8d1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:32:59.137860 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-423591f6-262f-481d-8afb-81580615c8d1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d" status: 200 len: 1576 microversion: 2.1 time: 0.171590 Aug 12 01:32:59.138586 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 330/666] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:32:58 2022] GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:32:59.842077 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-dedf7bf9-cccb-4188-b568-9491b8b44e13 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:32:59.845650 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-dedf7bf9-cccb-4188-b568-9491b8b44e13 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:32:59.856664 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dedf7bf9-cccb-4188-b568-9491b8b44e13 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:59.857471 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dedf7bf9-cccb-4188-b568-9491b8b44e13 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:59.858402 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dedf7bf9-cccb-4188-b568-9491b8b44e13 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:59.859596 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dedf7bf9-cccb-4188-b568-9491b8b44e13 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:32:59.860365 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dedf7bf9-cccb-4188-b568-9491b8b44e13 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:32:59.861402 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dedf7bf9-cccb-4188-b568-9491b8b44e13 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:32:59.892206 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-dedf7bf9-cccb-4188-b568-9491b8b44e13 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057036 Aug 12 01:32:59.892764 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 337/667] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 01:32:59 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:33:00.041256 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-6daab55c-b9a7-4703-a22c-1ab1d1049de4 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:00.042362 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-6daab55c-b9a7-4703-a22c-1ab1d1049de4 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: 30c8fb82-5cf9-4388-8481-285e8a09c261] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:00.054124 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6daab55c-b9a7-4703-a22c-1ab1d1049de4 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:00.054684 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6daab55c-b9a7-4703-a22c-1ab1d1049de4 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:00.055787 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6daab55c-b9a7-4703-a22c-1ab1d1049de4 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:00.057204 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6daab55c-b9a7-4703-a22c-1ab1d1049de4 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:00.057742 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6daab55c-b9a7-4703-a22c-1ab1d1049de4 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:00.058238 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6daab55c-b9a7-4703-a22c-1ab1d1049de4 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:00.160663 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-34a97b8c-18ab-426b-b2ec-13802c4d64d3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:00.161269 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-34a97b8c-18ab-426b-b2ec-13802c4d64d3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: a8c75c35-1961-4c9b-9208-ed9096bf447d] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:00.167418 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-34a97b8c-18ab-426b-b2ec-13802c4d64d3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:00.167935 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-34a97b8c-18ab-426b-b2ec-13802c4d64d3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:00.168373 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-34a97b8c-18ab-426b-b2ec-13802c4d64d3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:00.169066 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-34a97b8c-18ab-426b-b2ec-13802c4d64d3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:00.169512 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-34a97b8c-18ab-426b-b2ec-13802c4d64d3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:00.169937 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-34a97b8c-18ab-426b-b2ec-13802c4d64d3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:00.189322 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-6daab55c-b9a7-4703-a22c-1ab1d1049de4 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:00.197145 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-6daab55c-b9a7-4703-a22c-1ab1d1049de4 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261" status: 200 len: 1362 microversion: 2.1 time: 0.163441 Aug 12 01:33:00.197714 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 331/668] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:00 2022] GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:00.306374 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-34a97b8c-18ab-426b-b2ec-13802c4d64d3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:00.314095 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-34a97b8c-18ab-426b-b2ec-13802c4d64d3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d" status: 200 len: 1576 microversion: 2.1 time: 0.157306 Aug 12 01:33:00.314647 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 338/669] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:00 2022] GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:00.905341 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-524b8b1a-aeb1-4041-84ef-01775908719c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:00.907702 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-524b8b1a-aeb1-4041-84ef-01775908719c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:00.914428 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-524b8b1a-aeb1-4041-84ef-01775908719c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:00.914979 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-524b8b1a-aeb1-4041-84ef-01775908719c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:00.915477 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-524b8b1a-aeb1-4041-84ef-01775908719c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:00.916202 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-524b8b1a-aeb1-4041-84ef-01775908719c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:00.916637 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-524b8b1a-aeb1-4041-84ef-01775908719c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:00.917064 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-524b8b1a-aeb1-4041-84ef-01775908719c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:00.928513 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-f7ea394f-36be-4742-9cb2-ed3b33bcb225 req-4c98dd35-2c6e-4cb0-bb66-ad73a86ad4a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c8fb82-5cf9-4388-8481-285e8a09c261", "name": "network-vif-plugged", "status": "completed", "tag": "8c964826-a690-4806-b18b-226a035ba086"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:33:00.941664 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-f7ea394f-36be-4742-9cb2-ed3b33bcb225 req-4c98dd35-2c6e-4cb0-bb66-ad73a86ad4a8 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:00.942462 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-f7ea394f-36be-4742-9cb2-ed3b33bcb225 req-4c98dd35-2c6e-4cb0-bb66-ad73a86ad4a8 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:00.943085 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-f7ea394f-36be-4742-9cb2-ed3b33bcb225 req-4c98dd35-2c6e-4cb0-bb66-ad73a86ad4a8 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:00.953625 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-524b8b1a-aeb1-4041-84ef-01775908719c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052737 Aug 12 01:33:00.954587 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 332/670] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 01:33:00 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:33:00.957583 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-f7ea394f-36be-4742-9cb2-ed3b33bcb225 req-4c98dd35-2c6e-4cb0-bb66-ad73a86ad4a8 service nova] Creating event network-vif-plugged:8c964826-a690-4806-b18b-226a035ba086 for instance 30c8fb82-5cf9-4388-8481-285e8a09c261 on hv-cinder-78481 Aug 12 01:33:00.962974 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-f7ea394f-36be-4742-9cb2-ed3b33bcb225 req-4c98dd35-2c6e-4cb0-bb66-ad73a86ad4a8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039799 Aug 12 01:33:00.963888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 339/671] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:33:01.218411 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-f2aa70eb-928d-49fb-a67f-c9fbf114a74c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:01.219177 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-f2aa70eb-928d-49fb-a67f-c9fbf114a74c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: 30c8fb82-5cf9-4388-8481-285e8a09c261] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:01.225864 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f2aa70eb-928d-49fb-a67f-c9fbf114a74c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:01.226339 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f2aa70eb-928d-49fb-a67f-c9fbf114a74c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:01.226789 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f2aa70eb-928d-49fb-a67f-c9fbf114a74c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:01.227479 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f2aa70eb-928d-49fb-a67f-c9fbf114a74c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:01.227974 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f2aa70eb-928d-49fb-a67f-c9fbf114a74c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:01.228421 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f2aa70eb-928d-49fb-a67f-c9fbf114a74c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:01.334987 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-f2186320-df6b-4352-986f-370e14784cf6 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:01.336137 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-f2186320-df6b-4352-986f-370e14784cf6 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: a8c75c35-1961-4c9b-9208-ed9096bf447d] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:01.343381 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f2186320-df6b-4352-986f-370e14784cf6 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:01.344138 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f2186320-df6b-4352-986f-370e14784cf6 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:01.344735 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f2186320-df6b-4352-986f-370e14784cf6 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:01.345628 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f2186320-df6b-4352-986f-370e14784cf6 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:01.346369 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f2186320-df6b-4352-986f-370e14784cf6 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:01.346957 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f2186320-df6b-4352-986f-370e14784cf6 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:01.373306 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:33:01.375814 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-f2aa70eb-928d-49fb-a67f-c9fbf114a74c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:01.384752 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-f2aa70eb-928d-49fb-a67f-c9fbf114a74c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261" status: 200 len: 1362 microversion: 2.1 time: 0.170410 Aug 12 01:33:01.397705 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 333/672] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:01 2022] GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261 => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:01.520823 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-f2186320-df6b-4352-986f-370e14784cf6 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:01.522947 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-230652f1-8559-42de-84fa-c570efcad5a8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5eebf6c4-7c30-48e0-9a6d-e8e6cd1e6a66"}} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:33:01.525280 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-230652f1-8559-42de-84fa-c570efcad5a8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 033d7c0c-b5ff-43bb-995d-500a2c087f7d] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:01.529262 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-f2186320-df6b-4352-986f-370e14784cf6 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d" status: 200 len: 1576 microversion: 2.1 time: 0.198526 Aug 12 01:33:01.530440 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 340/673] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:01 2022] GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d => generated 1576 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:33:01.531634 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-230652f1-8559-42de-84fa-c570efcad5a8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:01.532116 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-230652f1-8559-42de-84fa-c570efcad5a8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:01.532542 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-230652f1-8559-42de-84fa-c570efcad5a8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:01.533413 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-230652f1-8559-42de-84fa-c570efcad5a8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:01.533856 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-230652f1-8559-42de-84fa-c570efcad5a8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:01.534274 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-230652f1-8559-42de-84fa-c570efcad5a8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:01.616427 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.wsgi [None req-230652f1-8559-42de-84fa-c570efcad5a8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] HTTP exception thrown: Invalid volume: volume 5eebf6c4-7c30-48e0-9a6d-e8e6cd1e6a66 is already attached to instances: 033d7c0c-b5ff-43bb-995d-500a2c087f7d Aug 12 01:33:01.618333 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-230652f1-8559-42de-84fa-c570efcad5a8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Request method failure captured: Aug 12 01:33:01.618333 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: request: POST /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d/os-volume_attachments HTTP/1.1 Aug 12 01:33:01.618333 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept: application/json Aug 12 01:33:01.618333 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept-Encoding: identity Aug 12 01:33:01.618333 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Connection: close Aug 12 01:33:01.618333 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Length: 74 Aug 12 01:33:01.618333 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Type: application/json Aug 12 01:33:01.618333 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Host: 10.222.0.20 Aug 12 01:33:01.618333 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Openstack-System-Scope: None Aug 12 01:33:01.618333 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: User-Agent: python-urllib3/1.26.11 Aug 12 01:33:01.618333 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Auth-Token: gAAAAABi9aysta1ExUaxXxQ9rYnSUQP7esxJrZzjQTGP-Rx-1mSW3FSa4Ni1V3s1gY-bX9pmoxF8Imm85iSgEmyp6i7Om1zZCTrheGnqYhUdvsswrsrCeMS3azlEhIm0ZDa-UZ_XH6zsXrFWA97-e9Lhn4LyTV3IcnRq62-QuKU-oVMmx5EzFRU Aug 12 01:33:01.618333 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Id: None Aug 12 01:33:01.618333 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Name: None Aug 12 01:33:01.618333 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Identity-Status: Confirmed Aug 12 01:33:01.618333 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Is-Admin-Project: True Aug 12 01:33:01.618333 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Id: default Aug 12 01:33:01.618333 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Name: Default Aug 12 01:33:01.618333 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Id: e5e2fd72103c4b5e956ef5b9c291f16d Aug 12 01:33:01.618333 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:33:01.618333 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Role: member,reader Aug 12 01:33:01.618333 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Roles: member,reader Aug 12 01:33:01.619787 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e5e2fd72103c4b5e956ef5b9c291f16d"}]}] Aug 12 01:33:01.619787 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:33:01.619787 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Id: e5e2fd72103c4b5e956ef5b9c291f16d Aug 12 01:33:01.619787 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:33:01.619787 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User: tempest-AttachVolumeNegativeTest-2079581927-project Aug 12 01:33:01.619787 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Id: default Aug 12 01:33:01.619787 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Name: Default Aug 12 01:33:01.619787 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Id: 4395876e1de944ae82d23d43a30a82a8 Aug 12 01:33:01.619787 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Name: tempest-AttachVolumeNegativeTest-2079581927-project Aug 12 01:33:01.619787 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Aug 12 01:33:01.619787 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: {"volumeAttachment": {"volumeId": "5eebf6c4-7c30-48e0-9a6d-e8e6cd1e6a66"}} Aug 12 01:33:01.619787 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: method: > Aug 12 01:33:01.620539 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: exception: Invalid volume: volume 5eebf6c4-7c30-48e0-9a6d-e8e6cd1e6a66 is already attached to instances: 033d7c0c-b5ff-43bb-995d-500a2c087f7d Aug 12 01:33:01.620539 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: action_args: {'server_id': '033d7c0c-b5ff-43bb-995d-500a2c087f7d', 'body': {'volumeAttachment': {'volumeId': '5eebf6c4-7c30-48e0-9a6d-e8e6cd1e6a66'}}} Aug 12 01:33:01.620539 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:33:01.620539 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:33:01.620539 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 12 01:33:01.620539 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 12 01:33:01.620539 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 12 01:33:01.620539 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 12 01:33:01.620539 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 12 01:33:01.620539 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 12 01:33:01.620539 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 12 01:33:01.620539 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 12 01:33:01.620539 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 12 01:33:01.620539 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 12 01:33:01.620539 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5eebf6c4-7c30-48e0-9a6d-e8e6cd1e6a66 is already attached to instances: 033d7c0c-b5ff-43bb-995d-500a2c087f7d Aug 12 01:33:01.620539 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:33:01.620539 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:33:01.620539 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:33:01.620539 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:33:01.621724 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:33:01.621724 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:33:01.621724 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:33:01.621724 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:33:01.621724 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:33:01.621724 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:33:01.621724 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 01:33:01.621724 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 01:33:01.621724 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 01:33:01.621724 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 01:33:01.621724 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 01:33:01.621724 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 01:33:01.621724 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 12 01:33:01.621724 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 12 01:33:01.621724 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5eebf6c4-7c30-48e0-9a6d-e8e6cd1e6a66 is already attached to instances: 033d7c0c-b5ff-43bb-995d-500a2c087f7d Aug 12 01:33:01.621724 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:33:01.621724 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:33:01.621724 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:33:01.621724 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:33:01.621724 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:33:01.623044 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:33:01.623044 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:33:01.623044 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:33:01.623044 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5eebf6c4-7c30-48e0-9a6d-e8e6cd1e6a66 is already attached to instances: 033d7c0c-b5ff-43bb-995d-500a2c087f7d Aug 12 01:33:01.623044 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:33:01.623044 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-230652f1-8559-42de-84fa-c570efcad5a8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Returning 400 to user: Invalid volume: volume 5eebf6c4-7c30-48e0-9a6d-e8e6cd1e6a66 is already attached to instances: 033d7c0c-b5ff-43bb-995d-500a2c087f7d {{(pid=120785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:33:01.623044 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-230652f1-8559-42de-84fa-c570efcad5a8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "POST /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100967 Aug 12 01:33:01.623044 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 334/674] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Aug 12 01:33:01 2022] POST /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 12 01:33:01.693362 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-577aa319-1cbd-46ec-889b-5a507dd3ca09 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:01.693849 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-577aa319-1cbd-46ec-889b-5a507dd3ca09 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 033d7c0c-b5ff-43bb-995d-500a2c087f7d] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:01.695763 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell0:SELECT=2 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:33:01.696547 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell0:SELECT=6 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:33:01.704451 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-577aa319-1cbd-46ec-889b-5a507dd3ca09 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:01.705006 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-577aa319-1cbd-46ec-889b-5a507dd3ca09 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:01.705586 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-577aa319-1cbd-46ec-889b-5a507dd3ca09 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:01.706384 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-577aa319-1cbd-46ec-889b-5a507dd3ca09 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:01.706842 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-577aa319-1cbd-46ec-889b-5a507dd3ca09 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:01.707287 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-577aa319-1cbd-46ec-889b-5a507dd3ca09 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:01.787129 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.objects.instance [None req-577aa319-1cbd-46ec-889b-5a507dd3ca09 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lazy-loading 'services' on Instance uuid 033d7c0c-b5ff-43bb-995d-500a2c087f7d {{(pid=120786) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 01:33:01.864635 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-577aa319-1cbd-46ec-889b-5a507dd3ca09 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "DELETE /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d/os-volume_attachments/5eebf6c4-7c30-48e0-9a6d-e8e6cd1e6a66" status: 202 len: 0 microversion: 2.1 time: 0.175255 Aug 12 01:33:01.865242 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 341/675] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Aug 12 01:33:01 2022] DELETE /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d/os-volume_attachments/5eebf6c4-7c30-48e0-9a6d-e8e6cd1e6a66 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 01:33:01.874001 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-dfae6854-493d-442e-85d8-e3f9c1d95160 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:01.876308 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-dfae6854-493d-442e-85d8-e3f9c1d95160 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 033d7c0c-b5ff-43bb-995d-500a2c087f7d] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:01.881601 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell0:SELECT=6 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:33:01.883284 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-dfae6854-493d-442e-85d8-e3f9c1d95160 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:01.883808 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-dfae6854-493d-442e-85d8-e3f9c1d95160 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:01.884244 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-dfae6854-493d-442e-85d8-e3f9c1d95160 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:01.884943 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-dfae6854-493d-442e-85d8-e3f9c1d95160 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:01.885545 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-dfae6854-493d-442e-85d8-e3f9c1d95160 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:01.885767 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-dfae6854-493d-442e-85d8-e3f9c1d95160 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:01.904974 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:33:01.923364 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-dfae6854-493d-442e-85d8-e3f9c1d95160 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053399 Aug 12 01:33:01.924272 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 335/676] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 01:33:01 2022] GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:33:01.936539 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-af5a8291-0e35-4d41-8bde-30545641617b req-e0dea058-1840-4d6a-b03c-e027f3312a5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8c75c35-1961-4c9b-9208-ed9096bf447d", "name": "network-vif-deleted", "tag": "de45b233-9e56-4b4c-b5fd-7f356b7e3307"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:33:01.946795 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-af5a8291-0e35-4d41-8bde-30545641617b req-e0dea058-1840-4d6a-b03c-e027f3312a5d service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:01.947258 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-af5a8291-0e35-4d41-8bde-30545641617b req-e0dea058-1840-4d6a-b03c-e027f3312a5d service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:01.947711 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-af5a8291-0e35-4d41-8bde-30545641617b req-e0dea058-1840-4d6a-b03c-e027f3312a5d service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:01.966429 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-d93f3a39-a2e6-44cb-b7eb-adc06b332374 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:01.968616 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-d93f3a39-a2e6-44cb-b7eb-adc06b332374 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:01.969162 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-af5a8291-0e35-4d41-8bde-30545641617b req-e0dea058-1840-4d6a-b03c-e027f3312a5d service nova] Creating event network-vif-deleted:de45b233-9e56-4b4c-b5fd-7f356b7e3307 for instance a8c75c35-1961-4c9b-9208-ed9096bf447d on hv-cinder-78481 Aug 12 01:33:01.976966 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-af5a8291-0e35-4d41-8bde-30545641617b req-e0dea058-1840-4d6a-b03c-e027f3312a5d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044024 Aug 12 01:33:01.977582 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 342/677] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:33:01.981957 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d93f3a39-a2e6-44cb-b7eb-adc06b332374 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:01.989368 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d93f3a39-a2e6-44cb-b7eb-adc06b332374 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:01.990242 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d93f3a39-a2e6-44cb-b7eb-adc06b332374 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:01.991076 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d93f3a39-a2e6-44cb-b7eb-adc06b332374 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:01.991689 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d93f3a39-a2e6-44cb-b7eb-adc06b332374 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:01.992355 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d93f3a39-a2e6-44cb-b7eb-adc06b332374 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:02.028456 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-d93f3a39-a2e6-44cb-b7eb-adc06b332374 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066675 Aug 12 01:33:02.029360 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 336/678] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 01:33:01 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 12 01:33:02.135024 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-69f7d0b5-0334-40c3-a797-e5c28e0c8987 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:02.135998 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-69f7d0b5-0334-40c3-a797-e5c28e0c8987 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:02.143360 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-69f7d0b5-0334-40c3-a797-e5c28e0c8987 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:02.143878 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-69f7d0b5-0334-40c3-a797-e5c28e0c8987 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:02.144307 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-69f7d0b5-0334-40c3-a797-e5c28e0c8987 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:02.145815 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-69f7d0b5-0334-40c3-a797-e5c28e0c8987 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:02.146722 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-69f7d0b5-0334-40c3-a797-e5c28e0c8987 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:02.147389 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-69f7d0b5-0334-40c3-a797-e5c28e0c8987 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:02.177070 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-69f7d0b5-0334-40c3-a797-e5c28e0c8987 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Going to try to terminate instance {{(pid=120786) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 01:33:02.271947 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-69f7d0b5-0334-40c3-a797-e5c28e0c8987 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 204 len: 0 microversion: 2.1 time: 0.141715 Aug 12 01:33:02.272536 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 343/679] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 01:33:02 2022] DELETE /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 01:33:02.280958 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-a7f4ef22-2add-4208-9939-1516d722a350 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:02.281775 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-a7f4ef22-2add-4208-9939-1516d722a350 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:02.288903 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a7f4ef22-2add-4208-9939-1516d722a350 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:02.289473 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a7f4ef22-2add-4208-9939-1516d722a350 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:02.289997 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a7f4ef22-2add-4208-9939-1516d722a350 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:02.290763 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a7f4ef22-2add-4208-9939-1516d722a350 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:02.291301 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a7f4ef22-2add-4208-9939-1516d722a350 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:02.291819 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a7f4ef22-2add-4208-9939-1516d722a350 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:02.405223 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-94373d0f-96ed-4df6-ac3d-4cfcc227ece9 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:02.405979 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-94373d0f-96ed-4df6-ac3d-4cfcc227ece9 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: 30c8fb82-5cf9-4388-8481-285e8a09c261] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:02.412684 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-94373d0f-96ed-4df6-ac3d-4cfcc227ece9 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:02.413170 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-94373d0f-96ed-4df6-ac3d-4cfcc227ece9 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:02.413585 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-94373d0f-96ed-4df6-ac3d-4cfcc227ece9 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:02.414278 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-94373d0f-96ed-4df6-ac3d-4cfcc227ece9 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:02.414722 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-94373d0f-96ed-4df6-ac3d-4cfcc227ece9 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:02.415106 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-94373d0f-96ed-4df6-ac3d-4cfcc227ece9 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:02.430647 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-a7f4ef22-2add-4208-9939-1516d722a350 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:02.439031 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-a7f4ef22-2add-4208-9939-1516d722a350 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1687 microversion: 2.1 time: 0.161999 Aug 12 01:33:02.439798 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 337/680] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:02 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:02.551276 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-86f2a4ad-29ae-4984-8051-ef4f9ab77e20 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:02.551956 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-86f2a4ad-29ae-4984-8051-ef4f9ab77e20 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: a8c75c35-1961-4c9b-9208-ed9096bf447d] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:02.561824 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-94373d0f-96ed-4df6-ac3d-4cfcc227ece9 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:02.564539 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-86f2a4ad-29ae-4984-8051-ef4f9ab77e20 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:02.566422 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-86f2a4ad-29ae-4984-8051-ef4f9ab77e20 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:02.566903 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-86f2a4ad-29ae-4984-8051-ef4f9ab77e20 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:02.567660 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-86f2a4ad-29ae-4984-8051-ef4f9ab77e20 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:02.570649 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-94373d0f-96ed-4df6-ac3d-4cfcc227ece9 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261" status: 200 len: 1362 microversion: 2.1 time: 0.169832 Aug 12 01:33:02.571773 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 344/681] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:02 2022] GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:33:02.572644 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-86f2a4ad-29ae-4984-8051-ef4f9ab77e20 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:02.574630 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-86f2a4ad-29ae-4984-8051-ef4f9ab77e20 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:02.650615 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-86f2a4ad-29ae-4984-8051-ef4f9ab77e20 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:02.658389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-86f2a4ad-29ae-4984-8051-ef4f9ab77e20 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d" status: 200 len: 1225 microversion: 2.1 time: 0.111592 Aug 12 01:33:02.658954 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 338/682] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:02 2022] GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d => generated 1225 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:02.936425 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-4b55636a-09d4-4fec-8fc4-9372fbba7d23 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:02.939094 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-4b55636a-09d4-4fec-8fc4-9372fbba7d23 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 033d7c0c-b5ff-43bb-995d-500a2c087f7d] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:02.945753 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4b55636a-09d4-4fec-8fc4-9372fbba7d23 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:02.946236 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4b55636a-09d4-4fec-8fc4-9372fbba7d23 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:02.946671 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4b55636a-09d4-4fec-8fc4-9372fbba7d23 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:02.947380 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4b55636a-09d4-4fec-8fc4-9372fbba7d23 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:02.947940 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4b55636a-09d4-4fec-8fc4-9372fbba7d23 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:02.948648 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4b55636a-09d4-4fec-8fc4-9372fbba7d23 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:02.979873 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-4b55636a-09d4-4fec-8fc4-9372fbba7d23 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047453 Aug 12 01:33:02.980669 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 345/683] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 01:33:02 2022] GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:33:03.464942 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-066b655f-b0c1-413b-96b8-ca16c6950ae4 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:03.465952 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-066b655f-b0c1-413b-96b8-ca16c6950ae4 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:03.474797 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-066b655f-b0c1-413b-96b8-ca16c6950ae4 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:03.475285 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-066b655f-b0c1-413b-96b8-ca16c6950ae4 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:03.475763 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-066b655f-b0c1-413b-96b8-ca16c6950ae4 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:03.476460 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-066b655f-b0c1-413b-96b8-ca16c6950ae4 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:03.476909 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-066b655f-b0c1-413b-96b8-ca16c6950ae4 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:03.477343 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-066b655f-b0c1-413b-96b8-ca16c6950ae4 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:03.594535 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-c5d1dbeb-75b7-4ae9-8d4e-df72acbced27 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:03.595148 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-c5d1dbeb-75b7-4ae9-8d4e-df72acbced27 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: 30c8fb82-5cf9-4388-8481-285e8a09c261] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:03.601450 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c5d1dbeb-75b7-4ae9-8d4e-df72acbced27 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:03.601926 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c5d1dbeb-75b7-4ae9-8d4e-df72acbced27 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:03.602515 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c5d1dbeb-75b7-4ae9-8d4e-df72acbced27 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:03.603211 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c5d1dbeb-75b7-4ae9-8d4e-df72acbced27 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:03.603691 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c5d1dbeb-75b7-4ae9-8d4e-df72acbced27 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:03.604220 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c5d1dbeb-75b7-4ae9-8d4e-df72acbced27 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:03.613654 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-066b655f-b0c1-413b-96b8-ca16c6950ae4 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:03.621469 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-066b655f-b0c1-413b-96b8-ca16c6950ae4 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1687 microversion: 2.1 time: 0.163361 Aug 12 01:33:03.622032 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 339/684] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:03 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:03.678915 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-b33b13ea-e426-4aee-8bca-4e0561ed0357 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:03.679515 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-b33b13ea-e426-4aee-8bca-4e0561ed0357 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: a8c75c35-1961-4c9b-9208-ed9096bf447d] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:03.685514 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b33b13ea-e426-4aee-8bca-4e0561ed0357 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:03.686027 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b33b13ea-e426-4aee-8bca-4e0561ed0357 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:03.686450 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b33b13ea-e426-4aee-8bca-4e0561ed0357 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:03.687131 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b33b13ea-e426-4aee-8bca-4e0561ed0357 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:03.687564 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b33b13ea-e426-4aee-8bca-4e0561ed0357 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:03.688008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b33b13ea-e426-4aee-8bca-4e0561ed0357 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:03.718478 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b33b13ea-e426-4aee-8bca-4e0561ed0357 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:03.718932 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b33b13ea-e426-4aee-8bca-4e0561ed0357 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:03.719359 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b33b13ea-e426-4aee-8bca-4e0561ed0357 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:03.719816 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.objects.instance [None req-b33b13ea-e426-4aee-8bca-4e0561ed0357 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lazy-loading 'fault' on Instance uuid a8c75c35-1961-4c9b-9208-ed9096bf447d {{(pid=120785) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 01:33:03.748071 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-c5d1dbeb-75b7-4ae9-8d4e-df72acbced27 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:03.755687 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-c5d1dbeb-75b7-4ae9-8d4e-df72acbced27 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261" status: 200 len: 1547 microversion: 2.1 time: 0.165129 Aug 12 01:33:03.756226 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 346/685] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:03 2022] GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261 => generated 1547 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:03.763590 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-b33b13ea-e426-4aee-8bca-4e0561ed0357 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:03.771396 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-b33b13ea-e426-4aee-8bca-4e0561ed0357 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d" status: 200 len: 1230 microversion: 2.1 time: 0.096689 Aug 12 01:33:03.772156 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 340/686] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:03 2022] GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d => generated 1230 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:03.775751 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-30095396-8e0a-4e4b-8c6c-47578965008d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:03.776234 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-30095396-8e0a-4e4b-8c6c-47578965008d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: 30c8fb82-5cf9-4388-8481-285e8a09c261] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:03.782471 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-30095396-8e0a-4e4b-8c6c-47578965008d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:03.783010 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-30095396-8e0a-4e4b-8c6c-47578965008d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:03.783470 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-30095396-8e0a-4e4b-8c6c-47578965008d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:03.784218 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-30095396-8e0a-4e4b-8c6c-47578965008d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:03.784666 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-30095396-8e0a-4e4b-8c6c-47578965008d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:03.785084 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-30095396-8e0a-4e4b-8c6c-47578965008d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:03.868625 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-30095396-8e0a-4e4b-8c6c-47578965008d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096723 Aug 12 01:33:03.869221 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 347/687] 10.222.0.20 () {58 vars in 1275 bytes} [Fri Aug 12 01:33:03 2022] GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:33:03.992699 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-8bdb02cd-e16c-4eca-a0be-0659ecb4e57f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:03.994947 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-8bdb02cd-e16c-4eca-a0be-0659ecb4e57f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 033d7c0c-b5ff-43bb-995d-500a2c087f7d] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:04.001018 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8bdb02cd-e16c-4eca-a0be-0659ecb4e57f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:04.001494 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8bdb02cd-e16c-4eca-a0be-0659ecb4e57f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:04.002042 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8bdb02cd-e16c-4eca-a0be-0659ecb4e57f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:04.002716 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8bdb02cd-e16c-4eca-a0be-0659ecb4e57f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:04.003158 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8bdb02cd-e16c-4eca-a0be-0659ecb4e57f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:04.003582 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8bdb02cd-e16c-4eca-a0be-0659ecb4e57f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:04.034315 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-8bdb02cd-e16c-4eca-a0be-0659ecb4e57f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045629 Aug 12 01:33:04.035002 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 341/688] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 01:33:03 2022] GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:33:04.642542 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-7df997e1-b863-44b4-9aec-aba89760e067 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:04.643160 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-7df997e1-b863-44b4-9aec-aba89760e067 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:04.649762 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7df997e1-b863-44b4-9aec-aba89760e067 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:04.650246 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7df997e1-b863-44b4-9aec-aba89760e067 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:04.650682 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7df997e1-b863-44b4-9aec-aba89760e067 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:04.651361 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7df997e1-b863-44b4-9aec-aba89760e067 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:04.651859 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7df997e1-b863-44b4-9aec-aba89760e067 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:04.652283 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7df997e1-b863-44b4-9aec-aba89760e067 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:04.793527 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-6e5f3ab3-28b5-4eca-8cdf-543a434592fc tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:04.794266 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-6e5f3ab3-28b5-4eca-8cdf-543a434592fc tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: a8c75c35-1961-4c9b-9208-ed9096bf447d] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:04.801589 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6e5f3ab3-28b5-4eca-8cdf-543a434592fc tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:04.802217 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6e5f3ab3-28b5-4eca-8cdf-543a434592fc tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:04.802754 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6e5f3ab3-28b5-4eca-8cdf-543a434592fc tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:04.804147 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6e5f3ab3-28b5-4eca-8cdf-543a434592fc tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:04.804694 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6e5f3ab3-28b5-4eca-8cdf-543a434592fc tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:04.805211 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6e5f3ab3-28b5-4eca-8cdf-543a434592fc tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:04.838366 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6e5f3ab3-28b5-4eca-8cdf-543a434592fc tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:04.838932 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6e5f3ab3-28b5-4eca-8cdf-543a434592fc tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:04.839480 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6e5f3ab3-28b5-4eca-8cdf-543a434592fc tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:04.840181 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.objects.instance [None req-6e5f3ab3-28b5-4eca-8cdf-543a434592fc tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lazy-loading 'fault' on Instance uuid a8c75c35-1961-4c9b-9208-ed9096bf447d {{(pid=120785) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 01:33:05.159564 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-7df997e1-b863-44b4-9aec-aba89760e067 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:05.163824 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-6e5f3ab3-28b5-4eca-8cdf-543a434592fc tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:05.167809 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-7df997e1-b863-44b4-9aec-aba89760e067 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1687 microversion: 2.1 time: 0.529931 Aug 12 01:33:05.169096 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 348/689] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:04 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1687 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:05.174481 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-2057f23b-d3d1-487b-b46d-fdcea72988b7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:05.176808 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-2057f23b-d3d1-487b-b46d-fdcea72988b7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 033d7c0c-b5ff-43bb-995d-500a2c087f7d] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:05.183090 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2057f23b-d3d1-487b-b46d-fdcea72988b7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:05.183598 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2057f23b-d3d1-487b-b46d-fdcea72988b7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:05.184029 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2057f23b-d3d1-487b-b46d-fdcea72988b7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:05.184725 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2057f23b-d3d1-487b-b46d-fdcea72988b7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:05.185169 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2057f23b-d3d1-487b-b46d-fdcea72988b7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:05.185711 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2057f23b-d3d1-487b-b46d-fdcea72988b7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:05.186921 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-6e5f3ab3-28b5-4eca-8cdf-543a434592fc tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d" status: 200 len: 1230 microversion: 2.1 time: 0.398221 Aug 12 01:33:05.187506 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 342/690] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:04 2022] GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d => generated 1230 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:05.192532 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-0b2ef9f6-0551-45b0-b07a-c673af1f2539 req-dedda951-53af-4915-b48f-15fe8dcf0571 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30c8fb82-5cf9-4388-8481-285e8a09c261", "tag": "8c964826-a690-4806-b18b-226a035ba086"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:33:05.202952 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-0b2ef9f6-0551-45b0-b07a-c673af1f2539 req-dedda951-53af-4915-b48f-15fe8dcf0571 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:05.203421 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-0b2ef9f6-0551-45b0-b07a-c673af1f2539 req-dedda951-53af-4915-b48f-15fe8dcf0571 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:05.203877 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-0b2ef9f6-0551-45b0-b07a-c673af1f2539 req-dedda951-53af-4915-b48f-15fe8dcf0571 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:05.215828 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-0b2ef9f6-0551-45b0-b07a-c673af1f2539 req-dedda951-53af-4915-b48f-15fe8dcf0571 service nova] Creating event network-changed:8c964826-a690-4806-b18b-226a035ba086 for instance 30c8fb82-5cf9-4388-8481-285e8a09c261 on hv-cinder-78481 Aug 12 01:33:05.218332 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-2057f23b-d3d1-487b-b46d-fdcea72988b7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048027 Aug 12 01:33:05.219996 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 349/691] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 01:33:05 2022] GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:33:05.221273 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-0b2ef9f6-0551-45b0-b07a-c673af1f2539 req-dedda951-53af-4915-b48f-15fe8dcf0571 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032342 Aug 12 01:33:05.221860 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 343/692] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:33:06.197470 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-354dc2b9-d1ad-4a51-bd04-08d3a212346d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:06.198437 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-354dc2b9-d1ad-4a51-bd04-08d3a212346d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:06.209466 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-354dc2b9-d1ad-4a51-bd04-08d3a212346d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:06.210266 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-354dc2b9-d1ad-4a51-bd04-08d3a212346d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:06.210984 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-354dc2b9-d1ad-4a51-bd04-08d3a212346d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:06.212201 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-354dc2b9-d1ad-4a51-bd04-08d3a212346d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:06.212950 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-354dc2b9-d1ad-4a51-bd04-08d3a212346d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:06.213186 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-8e88d9de-df3e-4ffd-874c-989e8afbb7e2 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:06.213911 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-354dc2b9-d1ad-4a51-bd04-08d3a212346d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:06.214079 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-8e88d9de-df3e-4ffd-874c-989e8afbb7e2 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: a8c75c35-1961-4c9b-9208-ed9096bf447d] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:06.223860 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8e88d9de-df3e-4ffd-874c-989e8afbb7e2 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:06.224337 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8e88d9de-df3e-4ffd-874c-989e8afbb7e2 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:06.224794 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8e88d9de-df3e-4ffd-874c-989e8afbb7e2 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:06.225475 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8e88d9de-df3e-4ffd-874c-989e8afbb7e2 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:06.225918 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8e88d9de-df3e-4ffd-874c-989e8afbb7e2 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:06.226394 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8e88d9de-df3e-4ffd-874c-989e8afbb7e2 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:06.258576 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8e88d9de-df3e-4ffd-874c-989e8afbb7e2 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:06.259052 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8e88d9de-df3e-4ffd-874c-989e8afbb7e2 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:06.259481 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8e88d9de-df3e-4ffd-874c-989e8afbb7e2 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:06.259958 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.objects.instance [None req-8e88d9de-df3e-4ffd-874c-989e8afbb7e2 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lazy-loading 'fault' on Instance uuid a8c75c35-1961-4c9b-9208-ed9096bf447d {{(pid=120785) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 01:33:06.316278 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-8e88d9de-df3e-4ffd-874c-989e8afbb7e2 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:06.323859 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-8e88d9de-df3e-4ffd-874c-989e8afbb7e2 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d" status: 200 len: 1230 microversion: 2.1 time: 0.118552 Aug 12 01:33:06.324442 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 344/693] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:06 2022] GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d => generated 1230 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:06.332396 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-d053a79b-47c6-4d2c-9f2e-265afd01a2e5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:06.332396 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-d053a79b-47c6-4d2c-9f2e-265afd01a2e5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 033d7c0c-b5ff-43bb-995d-500a2c087f7d] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:06.349657 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d053a79b-47c6-4d2c-9f2e-265afd01a2e5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:06.350296 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d053a79b-47c6-4d2c-9f2e-265afd01a2e5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:06.351010 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d053a79b-47c6-4d2c-9f2e-265afd01a2e5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:06.351834 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d053a79b-47c6-4d2c-9f2e-265afd01a2e5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:06.352397 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d053a79b-47c6-4d2c-9f2e-265afd01a2e5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:06.352942 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d053a79b-47c6-4d2c-9f2e-265afd01a2e5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:06.405259 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-d053a79b-47c6-4d2c-9f2e-265afd01a2e5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079758 Aug 12 01:33:06.405940 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 345/694] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 01:33:06 2022] GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:33:06.408594 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-354dc2b9-d1ad-4a51-bd04-08d3a212346d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:06.416907 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-354dc2b9-d1ad-4a51-bd04-08d3a212346d tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1687 microversion: 2.1 time: 0.225971 Aug 12 01:33:06.417571 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 350/695] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:06 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1687 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:07.349497 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-5a550d50-d6c8-40f4-9ab4-16e031b58245 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:07.350658 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-5a550d50-d6c8-40f4-9ab4-16e031b58245 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: a8c75c35-1961-4c9b-9208-ed9096bf447d] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:07.362175 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5a550d50-d6c8-40f4-9ab4-16e031b58245 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:07.362869 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5a550d50-d6c8-40f4-9ab4-16e031b58245 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:07.363484 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5a550d50-d6c8-40f4-9ab4-16e031b58245 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:07.364595 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5a550d50-d6c8-40f4-9ab4-16e031b58245 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:07.365049 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5a550d50-d6c8-40f4-9ab4-16e031b58245 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:07.365469 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5a550d50-d6c8-40f4-9ab4-16e031b58245 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:07.374545 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-960bee1a-0a74-403b-b21a-055f7258d419 req-43cceb2b-95e0-4e81-95c1-d7e01d9b00e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a", "name": "network-vif-deleted", "tag": "dc2ec8af-df9c-48b9-af2f-f3d087bf0f93"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:33:07.385605 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-960bee1a-0a74-403b-b21a-055f7258d419 req-43cceb2b-95e0-4e81-95c1-d7e01d9b00e5 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:07.386330 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-960bee1a-0a74-403b-b21a-055f7258d419 req-43cceb2b-95e0-4e81-95c1-d7e01d9b00e5 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:07.386905 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-960bee1a-0a74-403b-b21a-055f7258d419 req-43cceb2b-95e0-4e81-95c1-d7e01d9b00e5 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:07.392933 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.wsgi [None req-5a550d50-d6c8-40f4-9ab4-16e031b58245 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] HTTP exception thrown: Instance a8c75c35-1961-4c9b-9208-ed9096bf447d could not be found. Aug 12 01:33:07.394710 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-5a550d50-d6c8-40f4-9ab4-16e031b58245 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Request method failure captured: Aug 12 01:33:07.394710 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: request: GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d HTTP/1.1 Aug 12 01:33:07.394710 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept: application/json Aug 12 01:33:07.394710 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept-Encoding: identity Aug 12 01:33:07.394710 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Connection: close Aug 12 01:33:07.394710 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Length: 0 Aug 12 01:33:07.394710 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Type: application/json Aug 12 01:33:07.394710 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Host: 10.222.0.20 Aug 12 01:33:07.394710 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Openstack-System-Scope: None Aug 12 01:33:07.394710 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: User-Agent: python-urllib3/1.26.11 Aug 12 01:33:07.394710 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Auth-Token: gAAAAABi9az6XUnea8vGoWh6UZfza72nNL9KxVqN40zelsPgomF7wuYQq-g1kWUnikeO9Qg4dkfiqeYMY_BAF2L7w258PS9fhVXpMUnegsFF4NRihcJz9YttSumIc0gtGNUiDO8FqNLCfwaE1whzIwgFTj3x8ZWuCi0cfOy3c-edHEX9XbD5DL4 Aug 12 01:33:07.394710 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Id: None Aug 12 01:33:07.394710 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Name: None Aug 12 01:33:07.394710 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Identity-Status: Confirmed Aug 12 01:33:07.394710 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Is-Admin-Project: True Aug 12 01:33:07.394710 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Id: default Aug 12 01:33:07.394710 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Name: Default Aug 12 01:33:07.394710 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Id: 2ca05e52a1c94aa7a8877ea34c412c95 Aug 12 01:33:07.394710 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Name: tempest-TestVolumeBootPattern-700529332 Aug 12 01:33:07.394710 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Role: member,reader Aug 12 01:33:07.394710 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Roles: member,reader Aug 12 01:33:07.396373 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2ca05e52a1c94aa7a8877ea34c412c95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ca05e52a1c94aa7a8877ea34c412c95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2ca05e52a1c94aa7a8877ea34c412c95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ca05e52a1c94aa7a8877ea34c412c95"}]}] Aug 12 01:33:07.396373 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant: tempest-TestVolumeBootPattern-700529332 Aug 12 01:33:07.396373 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Id: 2ca05e52a1c94aa7a8877ea34c412c95 Aug 12 01:33:07.396373 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Name: tempest-TestVolumeBootPattern-700529332 Aug 12 01:33:07.396373 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User: tempest-TestVolumeBootPattern-700529332-project Aug 12 01:33:07.396373 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Id: default Aug 12 01:33:07.396373 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Name: Default Aug 12 01:33:07.396373 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Id: 166e2f065c674cc0a6465f3d0d6bbb4d Aug 12 01:33:07.396373 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Name: tempest-TestVolumeBootPattern-700529332-project Aug 12 01:33:07.396373 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: method: > Aug 12 01:33:07.396373 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: exception: Instance a8c75c35-1961-4c9b-9208-ed9096bf447d could not be found. Aug 12 01:33:07.396373 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: action_args: {'id': 'a8c75c35-1961-4c9b-9208-ed9096bf447d'} Aug 12 01:33:07.397288 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:33:07.397288 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:33:07.397288 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:33:07.397288 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:33:07.397288 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:33:07.397288 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:33:07.397288 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:33:07.397288 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:33:07.397288 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:33:07.397288 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:33:07.397288 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8c75c35-1961-4c9b-9208-ed9096bf447d could not be found. Aug 12 01:33:07.397288 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:33:07.397288 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:33:07.397288 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:33:07.397288 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:33:07.397288 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:33:07.397288 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:33:07.397288 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:33:07.397288 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:33:07.397288 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:33:07.398705 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:33:07.398705 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 01:33:07.398705 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 01:33:07.398705 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:33:07.398705 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:33:07.398705 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:33:07.398705 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:33:07.398705 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8c75c35-1961-4c9b-9208-ed9096bf447d could not be found. Aug 12 01:33:07.398705 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:33:07.398705 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:33:07.398705 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:33:07.398705 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:33:07.398705 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:33:07.398705 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:33:07.398705 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:33:07.398705 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:33:07.398705 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8c75c35-1961-4c9b-9208-ed9096bf447d could not be found. Aug 12 01:33:07.398705 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:33:07.400007 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-5a550d50-d6c8-40f4-9ab4-16e031b58245 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Returning 404 to user: Instance a8c75c35-1961-4c9b-9208-ed9096bf447d could not be found. {{(pid=120785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:33:07.400007 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-5a550d50-d6c8-40f4-9ab4-16e031b58245 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d" status: 404 len: 111 microversion: 2.1 time: 0.051796 Aug 12 01:33:07.405932 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-960bee1a-0a74-403b-b21a-055f7258d419 req-43cceb2b-95e0-4e81-95c1-d7e01d9b00e5 service nova] Creating event network-vif-deleted:dc2ec8af-df9c-48b9-af2f-f3d087bf0f93 for instance f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a on hv-cinder-78481 Aug 12 01:33:07.406108 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 346/696] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:07 2022] GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:33:07.412993 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-960bee1a-0a74-403b-b21a-055f7258d419 req-43cceb2b-95e0-4e81-95c1-d7e01d9b00e5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041879 Aug 12 01:33:07.414448 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 351/697] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:33:07.426057 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-95162368-fd38-4adb-98e4-755eaab56cd6 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:07.434250 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-95162368-fd38-4adb-98e4-755eaab56cd6 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 033d7c0c-b5ff-43bb-995d-500a2c087f7d] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:07.439435 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-fd6a9dc8-b5b1-4f54-b07b-f657362732fd tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:07.440422 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-fd6a9dc8-b5b1-4f54-b07b-f657362732fd tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:07.446870 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-95162368-fd38-4adb-98e4-755eaab56cd6 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:07.447346 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-95162368-fd38-4adb-98e4-755eaab56cd6 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:07.447802 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-95162368-fd38-4adb-98e4-755eaab56cd6 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:07.448503 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-95162368-fd38-4adb-98e4-755eaab56cd6 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:07.449112 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-95162368-fd38-4adb-98e4-755eaab56cd6 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:07.449809 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-95162368-fd38-4adb-98e4-755eaab56cd6 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:07.451517 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fd6a9dc8-b5b1-4f54-b07b-f657362732fd tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:07.452034 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fd6a9dc8-b5b1-4f54-b07b-f657362732fd tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:07.452464 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fd6a9dc8-b5b1-4f54-b07b-f657362732fd tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:07.453158 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fd6a9dc8-b5b1-4f54-b07b-f657362732fd tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:07.456653 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fd6a9dc8-b5b1-4f54-b07b-f657362732fd tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:07.457258 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fd6a9dc8-b5b1-4f54-b07b-f657362732fd tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:07.514663 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-95162368-fd38-4adb-98e4-755eaab56cd6 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092865 Aug 12 01:33:07.515626 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 347/698] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 01:33:07 2022] GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 01:33:07.571022 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-db921dcc-89eb-491d-951b-ed77f4851adb tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-466996721", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-140950627", "security_groups": [{"name": "tempest-secgroup-smoke-531838359"}], "block_device_mapping_v2": [{"uuid": "6deaeffb-e772-43e5-8d3b-e60e9415e56b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4d3c14b0-d6e3-49a6-94a3-2110714459d1"}]}} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:33:07.589117 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-fd6a9dc8-b5b1-4f54-b07b-f657362732fd tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:07.598295 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-fd6a9dc8-b5b1-4f54-b07b-f657362732fd tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1330 microversion: 2.1 time: 0.163697 Aug 12 01:33:07.598879 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 352/699] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:07 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1330 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:33:07.614008 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-83b759d6-c96f-4910-95cb-51381d220804 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:07.614801 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-83b759d6-c96f-4910-95cb-51381d220804 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 033d7c0c-b5ff-43bb-995d-500a2c087f7d] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:07.623130 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-83b759d6-c96f-4910-95cb-51381d220804 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:07.623966 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-83b759d6-c96f-4910-95cb-51381d220804 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:07.624584 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-83b759d6-c96f-4910-95cb-51381d220804 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:07.625466 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-83b759d6-c96f-4910-95cb-51381d220804 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:07.626064 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-83b759d6-c96f-4910-95cb-51381d220804 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:07.626823 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-83b759d6-c96f-4910-95cb-51381d220804 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:07.666673 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-83b759d6-c96f-4910-95cb-51381d220804 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 033d7c0c-b5ff-43bb-995d-500a2c087f7d] Going to try to terminate instance {{(pid=120786) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 01:33:07.716424 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.network.neutron [None req-db921dcc-89eb-491d-951b-ed77f4851adb tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] validate_networks() for [('4d3c14b0-d6e3-49a6-94a3-2110714459d1', None, None, None, None, None)] {{(pid=120785) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 01:33:07.762861 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-83b759d6-c96f-4910-95cb-51381d220804 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "DELETE /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d" status: 204 len: 0 microversion: 2.1 time: 0.155264 Aug 12 01:33:07.763696 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 353/700] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 01:33:07 2022] DELETE /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 01:33:07.772980 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-57046fa0-7817-42c4-8af6-581e75882013 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:07.773777 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-57046fa0-7817-42c4-8af6-581e75882013 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 033d7c0c-b5ff-43bb-995d-500a2c087f7d] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:07.780150 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-57046fa0-7817-42c4-8af6-581e75882013 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:07.780649 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-57046fa0-7817-42c4-8af6-581e75882013 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:07.781071 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-57046fa0-7817-42c4-8af6-581e75882013 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:07.782433 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-57046fa0-7817-42c4-8af6-581e75882013 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:07.782433 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-57046fa0-7817-42c4-8af6-581e75882013 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:07.782812 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-57046fa0-7817-42c4-8af6-581e75882013 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:07.993430 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-57046fa0-7817-42c4-8af6-581e75882013 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:07.997113 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:33:08.002146 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-57046fa0-7817-42c4-8af6-581e75882013 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d" status: 200 len: 1681 microversion: 2.1 time: 0.233500 Aug 12 01:33:08.002979 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 354/701] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:07 2022] GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d => generated 1681 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:33:08.170370 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-db921dcc-89eb-491d-951b-ed77f4851adb tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Flavor limits 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 01:33:08.170798 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-db921dcc-89eb-491d-951b-ed77f4851adb tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Image limits 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 01:33:08.171267 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-db921dcc-89eb-491d-951b-ed77f4851adb tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Flavor pref 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 01:33:08.171725 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-db921dcc-89eb-491d-951b-ed77f4851adb tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Image pref 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 01:33:08.172136 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-db921dcc-89eb-491d-951b-ed77f4851adb tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 01:33:08.182525 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-db921dcc-89eb-491d-951b-ed77f4851adb tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:08.183003 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-db921dcc-89eb-491d-951b-ed77f4851adb tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:08.183438 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-db921dcc-89eb-491d-951b-ed77f4851adb tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:08.184200 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-db921dcc-89eb-491d-951b-ed77f4851adb tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:08.184649 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-db921dcc-89eb-491d-951b-ed77f4851adb tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:08.185075 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-db921dcc-89eb-491d-951b-ed77f4851adb tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:08.202261 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.quota [None req-db921dcc-89eb-491d-951b-ed77f4851adb tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Getting quotas for project 2ca05e52a1c94aa7a8877ea34c412c95. Resources: {'cores', 'ram', 'instances'} {{(pid=120785) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 01:33:08.204621 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:33:08.207602 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.quota [None req-db921dcc-89eb-491d-951b-ed77f4851adb tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Getting quotas for user 166e2f065c674cc0a6465f3d0d6bbb4d and project 2ca05e52a1c94aa7a8877ea34c412c95. Resources: {'cores', 'ram', 'instances'} {{(pid=120785) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 01:33:08.269266 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-db921dcc-89eb-491d-951b-ed77f4851adb tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Going to run 1 instances... {{(pid=120785) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 01:33:08.271352 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-db921dcc-89eb-491d-951b-ed77f4851adb tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: e61e785b-aa63-4b29-b82d-185988c73bc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6deaeffb-e772-43e5-8d3b-e60e9415e56b',volume_size=None,volume_type=None)] {{(pid=120785) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 01:33:08.412314 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-db921dcc-89eb-491d-951b-ed77f4851adb tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.845904 Aug 12 01:33:08.413332 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 348/702] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 01:33:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 12 01:33:08.424500 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-45c6f202-f791-4d9a-8811-b36a8e169b9d tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:08.425025 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-45c6f202-f791-4d9a-8811-b36a8e169b9d tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: e61e785b-aa63-4b29-b82d-185988c73bc1] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:08.489774 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-45c6f202-f791-4d9a-8811-b36a8e169b9d tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:08.498338 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-45c6f202-f791-4d9a-8811-b36a8e169b9d tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1" status: 200 len: 1093 microversion: 2.1 time: 0.077779 Aug 12 01:33:08.498898 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 355/703] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:08 2022] GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1 => generated 1093 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:08.626266 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-64f7a7ed-5e94-4a36-a923-5a3e18092b05 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:08.627240 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-64f7a7ed-5e94-4a36-a923-5a3e18092b05 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:08.637019 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-64f7a7ed-5e94-4a36-a923-5a3e18092b05 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:08.637602 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-64f7a7ed-5e94-4a36-a923-5a3e18092b05 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:08.637915 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-64f7a7ed-5e94-4a36-a923-5a3e18092b05 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:08.638620 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-64f7a7ed-5e94-4a36-a923-5a3e18092b05 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:08.639068 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-64f7a7ed-5e94-4a36-a923-5a3e18092b05 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:08.639485 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-64f7a7ed-5e94-4a36-a923-5a3e18092b05 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:08.672330 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-64f7a7ed-5e94-4a36-a923-5a3e18092b05 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:08.672805 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-64f7a7ed-5e94-4a36-a923-5a3e18092b05 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:08.673236 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-64f7a7ed-5e94-4a36-a923-5a3e18092b05 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:08.673679 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.objects.instance [None req-64f7a7ed-5e94-4a36-a923-5a3e18092b05 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lazy-loading 'fault' on Instance uuid f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a {{(pid=120785) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 01:33:08.719851 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-64f7a7ed-5e94-4a36-a923-5a3e18092b05 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:08.728049 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-64f7a7ed-5e94-4a36-a923-5a3e18092b05 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 200 len: 1335 microversion: 2.1 time: 0.110392 Aug 12 01:33:08.734645 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 349/704] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:08 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 1335 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:09.024348 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-4a65f8fc-d1a3-47a1-b5c9-2576587e3827 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:09.024971 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-4a65f8fc-d1a3-47a1-b5c9-2576587e3827 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 033d7c0c-b5ff-43bb-995d-500a2c087f7d] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:09.027980 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:33:09.032401 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4a65f8fc-d1a3-47a1-b5c9-2576587e3827 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:09.032881 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4a65f8fc-d1a3-47a1-b5c9-2576587e3827 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:09.033325 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4a65f8fc-d1a3-47a1-b5c9-2576587e3827 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:09.034010 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4a65f8fc-d1a3-47a1-b5c9-2576587e3827 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:09.034458 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4a65f8fc-d1a3-47a1-b5c9-2576587e3827 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:09.034927 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4a65f8fc-d1a3-47a1-b5c9-2576587e3827 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:09.184828 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-4a65f8fc-d1a3-47a1-b5c9-2576587e3827 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:09.193062 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-4a65f8fc-d1a3-47a1-b5c9-2576587e3827 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d" status: 200 len: 1681 microversion: 2.1 time: 0.172745 Aug 12 01:33:09.193646 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 356/705] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:09 2022] GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:09.522116 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-db7b89f9-75bd-44ae-ba4e-808167665f37 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:09.522717 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-db7b89f9-75bd-44ae-ba4e-808167665f37 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: e61e785b-aa63-4b29-b82d-185988c73bc1] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:09.529787 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-db7b89f9-75bd-44ae-ba4e-808167665f37 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:09.530258 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-db7b89f9-75bd-44ae-ba4e-808167665f37 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:09.530681 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-db7b89f9-75bd-44ae-ba4e-808167665f37 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:09.531360 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-db7b89f9-75bd-44ae-ba4e-808167665f37 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:09.531828 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-db7b89f9-75bd-44ae-ba4e-808167665f37 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:09.532243 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-db7b89f9-75bd-44ae-ba4e-808167665f37 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:09.596982 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-db7b89f9-75bd-44ae-ba4e-808167665f37 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:09.604871 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-db7b89f9-75bd-44ae-ba4e-808167665f37 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1" status: 200 len: 1191 microversion: 2.1 time: 0.088534 Aug 12 01:33:09.605407 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 350/706] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:09 2022] GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1 => generated 1191 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:09.953983 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-fc68b247-08b7-4e22-a1d2-f154c4b2d9bd tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:09.955181 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-fc68b247-08b7-4e22-a1d2-f154c4b2d9bd tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:09.961627 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fc68b247-08b7-4e22-a1d2-f154c4b2d9bd tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:09.962154 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fc68b247-08b7-4e22-a1d2-f154c4b2d9bd tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:09.962582 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fc68b247-08b7-4e22-a1d2-f154c4b2d9bd tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:09.963270 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fc68b247-08b7-4e22-a1d2-f154c4b2d9bd tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:09.963904 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fc68b247-08b7-4e22-a1d2-f154c4b2d9bd tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:09.964322 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fc68b247-08b7-4e22-a1d2-f154c4b2d9bd tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:09.978593 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.wsgi [None req-fc68b247-08b7-4e22-a1d2-f154c4b2d9bd tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] HTTP exception thrown: Instance f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a could not be found. Aug 12 01:33:09.980799 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-fc68b247-08b7-4e22-a1d2-f154c4b2d9bd tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Request method failure captured: Aug 12 01:33:09.980799 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: request: GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a HTTP/1.1 Aug 12 01:33:09.980799 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept: application/json Aug 12 01:33:09.980799 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept-Encoding: identity Aug 12 01:33:09.980799 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Connection: close Aug 12 01:33:09.980799 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Length: 0 Aug 12 01:33:09.980799 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Type: application/json Aug 12 01:33:09.980799 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Host: 10.222.0.20 Aug 12 01:33:09.980799 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Openstack-System-Scope: None Aug 12 01:33:09.980799 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: User-Agent: python-urllib3/1.26.11 Aug 12 01:33:09.980799 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Auth-Token: gAAAAABi9ayoxsO4pebdlbGb3TfC7pdsTDHM0zBbhW1rROXCyh2X3MU63lrNyuI5JBIvpFkBHWmOhzN7hT_Ph2EuZvp68TczP4qOdjp2u2mGnkKXiIsRPx1ARWLioQm2PsX7zkhWbZDIo2KgE_MjWZnupOgbzAN6WD9weMJ2_q2Y0YfQ_YfoyX8 Aug 12 01:33:09.980799 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Id: None Aug 12 01:33:09.980799 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Name: None Aug 12 01:33:09.980799 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Identity-Status: Confirmed Aug 12 01:33:09.980799 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Is-Admin-Project: True Aug 12 01:33:09.980799 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Id: default Aug 12 01:33:09.980799 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Name: Default Aug 12 01:33:09.980799 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Id: a0674e4f240748d69cc9be8fdc79ad89 Aug 12 01:33:09.980799 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1607139389 Aug 12 01:33:09.980799 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Role: member,reader Aug 12 01:33:09.980799 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Roles: member,reader Aug 12 01:33:09.982198 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a0674e4f240748d69cc9be8fdc79ad89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0674e4f240748d69cc9be8fdc79ad89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a0674e4f240748d69cc9be8fdc79ad89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0674e4f240748d69cc9be8fdc79ad89"}]}] Aug 12 01:33:09.982198 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1607139389 Aug 12 01:33:09.982198 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Id: a0674e4f240748d69cc9be8fdc79ad89 Aug 12 01:33:09.982198 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1607139389 Aug 12 01:33:09.982198 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User: tempest-ServerRescueNegativeTestJSON-1607139389-project Aug 12 01:33:09.982198 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Id: default Aug 12 01:33:09.982198 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Name: Default Aug 12 01:33:09.982198 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Id: fed1b143e80642328bb5c7c78cacedcd Aug 12 01:33:09.982198 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1607139389-project Aug 12 01:33:09.982198 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: method: > Aug 12 01:33:09.982198 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: exception: Instance f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a could not be found. Aug 12 01:33:09.982198 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: action_args: {'id': 'f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a'} Aug 12 01:33:09.983126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:33:09.983126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:33:09.983126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:33:09.983126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:33:09.983126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:33:09.983126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:33:09.983126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:33:09.983126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:33:09.983126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:33:09.983126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:33:09.983126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a could not be found. Aug 12 01:33:09.983126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:33:09.983126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:33:09.983126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:33:09.983126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:33:09.983126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:33:09.983126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:33:09.983126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:33:09.983126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:33:09.983126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:33:09.984364 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:33:09.984364 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 01:33:09.984364 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 01:33:09.984364 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:33:09.984364 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:33:09.984364 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:33:09.984364 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:33:09.984364 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a could not be found. Aug 12 01:33:09.984364 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:33:09.984364 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:33:09.984364 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:33:09.984364 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:33:09.984364 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:33:09.984364 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:33:09.984364 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:33:09.984364 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:33:09.984364 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a could not be found. Aug 12 01:33:09.984364 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:33:09.985402 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-fc68b247-08b7-4e22-a1d2-f154c4b2d9bd tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Returning 404 to user: Instance f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a could not be found. {{(pid=120786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:33:09.985402 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-fc68b247-08b7-4e22-a1d2-f154c4b2d9bd tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a" status: 404 len: 111 microversion: 2.1 time: 0.237158 Aug 12 01:33:09.986077 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 357/707] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:09 2022] GET /compute/v2.1/servers/f7c0c9ad-4ca6-445b-bfea-0b3f3b6cb70a => generated 111 bytes in 242 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 12 01:33:09.991725 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-a0de31e3-b7ba-4543-b9a8-7e064b51abb0 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '.version_select at 0x7f2decd5a700>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:10.021182 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-a0de31e3-b7ba-4543-b9a8-7e064b51abb0 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-562424958" status: 202 len: 0 microversion: 2.1 time: 0.033311 Aug 12 01:33:10.022247 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 351/708] 10.222.0.20 () {58 vars in 1218 bytes} [Fri Aug 12 01:33:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-562424958 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 01:33:10.214762 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-dc239613-4596-436e-8057-26aeb31330af tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:10.216360 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-dc239613-4596-436e-8057-26aeb31330af tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 033d7c0c-b5ff-43bb-995d-500a2c087f7d] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:10.231875 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dc239613-4596-436e-8057-26aeb31330af tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:10.233620 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dc239613-4596-436e-8057-26aeb31330af tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:10.236534 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dc239613-4596-436e-8057-26aeb31330af tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:10.238348 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dc239613-4596-436e-8057-26aeb31330af tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:10.239185 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dc239613-4596-436e-8057-26aeb31330af tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:10.240242 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dc239613-4596-436e-8057-26aeb31330af tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:10.398704 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-dc239613-4596-436e-8057-26aeb31330af tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:10.408258 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-dc239613-4596-436e-8057-26aeb31330af tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d" status: 200 len: 1614 microversion: 2.1 time: 0.197696 Aug 12 01:33:10.409237 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 358/709] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:10 2022] GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d => generated 1614 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:10.627653 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-55c0a6e9-e053-4c37-b0e1-2894fe4c9822 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:10.629019 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-55c0a6e9-e053-4c37-b0e1-2894fe4c9822 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: e61e785b-aa63-4b29-b82d-185988c73bc1] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:10.637409 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-55c0a6e9-e053-4c37-b0e1-2894fe4c9822 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:10.638268 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-55c0a6e9-e053-4c37-b0e1-2894fe4c9822 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:10.638903 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-55c0a6e9-e053-4c37-b0e1-2894fe4c9822 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:10.639851 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-55c0a6e9-e053-4c37-b0e1-2894fe4c9822 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:10.640570 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-55c0a6e9-e053-4c37-b0e1-2894fe4c9822 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:10.641195 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-55c0a6e9-e053-4c37-b0e1-2894fe4c9822 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:10.763829 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-55c0a6e9-e053-4c37-b0e1-2894fe4c9822 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:10.779194 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-55c0a6e9-e053-4c37-b0e1-2894fe4c9822 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1" status: 200 len: 1197 microversion: 2.1 time: 0.156262 Aug 12 01:33:10.781532 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 352/710] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:10 2022] GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1 => generated 1197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:33:10.898615 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-3c52332e-c327-4920-b181-52e931b452b4 req-d920e754-ce34-4c3e-aca3-40359b3f6a4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "033d7c0c-b5ff-43bb-995d-500a2c087f7d", "name": "network-vif-deleted", "tag": "ce8f5755-06ab-4852-bd78-2e3e7aaea221"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:33:10.918649 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-3c52332e-c327-4920-b181-52e931b452b4 req-d920e754-ce34-4c3e-aca3-40359b3f6a4e service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:10.919408 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-3c52332e-c327-4920-b181-52e931b452b4 req-d920e754-ce34-4c3e-aca3-40359b3f6a4e service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:10.922275 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-3c52332e-c327-4920-b181-52e931b452b4 req-d920e754-ce34-4c3e-aca3-40359b3f6a4e service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:10.948887 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-3c52332e-c327-4920-b181-52e931b452b4 req-d920e754-ce34-4c3e-aca3-40359b3f6a4e service nova] Creating event network-vif-deleted:ce8f5755-06ab-4852-bd78-2e3e7aaea221 for instance 033d7c0c-b5ff-43bb-995d-500a2c087f7d on hv-cinder-78481 Aug 12 01:33:10.955825 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-3c52332e-c327-4920-b181-52e931b452b4 req-d920e754-ce34-4c3e-aca3-40359b3f6a4e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059949 Aug 12 01:33:10.959581 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 359/711] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:33:11.430905 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-cb048711-21af-49bf-a73c-04b2d9e41388 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:11.431554 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-cb048711-21af-49bf-a73c-04b2d9e41388 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 033d7c0c-b5ff-43bb-995d-500a2c087f7d] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:11.449553 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cb048711-21af-49bf-a73c-04b2d9e41388 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:11.450043 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cb048711-21af-49bf-a73c-04b2d9e41388 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:11.450724 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cb048711-21af-49bf-a73c-04b2d9e41388 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:11.451696 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cb048711-21af-49bf-a73c-04b2d9e41388 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:11.452144 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cb048711-21af-49bf-a73c-04b2d9e41388 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:11.452596 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cb048711-21af-49bf-a73c-04b2d9e41388 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:11.548642 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cb048711-21af-49bf-a73c-04b2d9e41388 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:11.549466 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cb048711-21af-49bf-a73c-04b2d9e41388 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:11.550517 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cb048711-21af-49bf-a73c-04b2d9e41388 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:11.551179 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.objects.instance [None req-cb048711-21af-49bf-a73c-04b2d9e41388 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lazy-loading 'fault' on Instance uuid 033d7c0c-b5ff-43bb-995d-500a2c087f7d {{(pid=120785) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 01:33:11.557629 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell1:SELECT=100 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:33:11.607805 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-cb048711-21af-49bf-a73c-04b2d9e41388 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:11.616315 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-cb048711-21af-49bf-a73c-04b2d9e41388 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d" status: 200 len: 1331 microversion: 2.1 time: 0.189882 Aug 12 01:33:11.617731 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 353/712] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:11 2022] GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d => generated 1331 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:11.802266 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-605305db-e4fb-4b79-9420-d0a86fb80e43 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:11.803629 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-605305db-e4fb-4b79-9420-d0a86fb80e43 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: e61e785b-aa63-4b29-b82d-185988c73bc1] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:11.812405 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-605305db-e4fb-4b79-9420-d0a86fb80e43 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:11.813629 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-605305db-e4fb-4b79-9420-d0a86fb80e43 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:11.814265 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-605305db-e4fb-4b79-9420-d0a86fb80e43 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:11.815955 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-605305db-e4fb-4b79-9420-d0a86fb80e43 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:11.816714 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-605305db-e4fb-4b79-9420-d0a86fb80e43 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:11.817378 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-605305db-e4fb-4b79-9420-d0a86fb80e43 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:11.909107 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-2c69e330-2b5a-4cdf-9e7e-7c0955ed8ceb req-4f78e477-f5cf-45c2-b0a0-078a108068f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e61e785b-aa63-4b29-b82d-185988c73bc1", "tag": "7f3a189a-2823-4a1c-8884-bc1b49992c1c"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:33:11.931851 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-2c69e330-2b5a-4cdf-9e7e-7c0955ed8ceb req-4f78e477-f5cf-45c2-b0a0-078a108068f4 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:11.932605 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-2c69e330-2b5a-4cdf-9e7e-7c0955ed8ceb req-4f78e477-f5cf-45c2-b0a0-078a108068f4 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:11.933845 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-2c69e330-2b5a-4cdf-9e7e-7c0955ed8ceb req-4f78e477-f5cf-45c2-b0a0-078a108068f4 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:11.955944 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-2c69e330-2b5a-4cdf-9e7e-7c0955ed8ceb req-4f78e477-f5cf-45c2-b0a0-078a108068f4 service nova] Creating event network-changed:7f3a189a-2823-4a1c-8884-bc1b49992c1c for instance e61e785b-aa63-4b29-b82d-185988c73bc1 on hv-cinder-78481 Aug 12 01:33:11.963949 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-2c69e330-2b5a-4cdf-9e7e-7c0955ed8ceb req-4f78e477-f5cf-45c2-b0a0-078a108068f4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063715 Aug 12 01:33:11.965784 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 354/713] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:33:11.981139 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-605305db-e4fb-4b79-9420-d0a86fb80e43 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:11.991272 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-605305db-e4fb-4b79-9420-d0a86fb80e43 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1" status: 200 len: 1264 microversion: 2.1 time: 0.193262 Aug 12 01:33:11.992048 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 360/714] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:11 2022] GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1 => generated 1264 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:12.131559 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-056654a9-1eb4-4ef9-99b0-b83d9d02debf tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:12.132165 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-056654a9-1eb4-4ef9-99b0-b83d9d02debf tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:12.138770 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-056654a9-1eb4-4ef9-99b0-b83d9d02debf tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:12.139246 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-056654a9-1eb4-4ef9-99b0-b83d9d02debf tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:12.139717 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-056654a9-1eb4-4ef9-99b0-b83d9d02debf tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:12.140402 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-056654a9-1eb4-4ef9-99b0-b83d9d02debf tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:12.140844 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-056654a9-1eb4-4ef9-99b0-b83d9d02debf tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:12.141260 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-056654a9-1eb4-4ef9-99b0-b83d9d02debf tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:12.164516 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-056654a9-1eb4-4ef9-99b0-b83d9d02debf tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da/ips" status: 200 len: 152 microversion: 2.20 time: 0.037420 Aug 12 01:33:12.165121 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 355/715] 10.222.0.20 () {60 vars in 1289 bytes} [Fri Aug 12 01:33:12 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 01:33:12.641581 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-376c01ba-ccc5-4679-a0ce-beaaecddd419 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:12.642181 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-376c01ba-ccc5-4679-a0ce-beaaecddd419 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 033d7c0c-b5ff-43bb-995d-500a2c087f7d] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:12.648911 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-376c01ba-ccc5-4679-a0ce-beaaecddd419 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:12.649542 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-376c01ba-ccc5-4679-a0ce-beaaecddd419 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:12.649929 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-376c01ba-ccc5-4679-a0ce-beaaecddd419 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:12.650640 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-376c01ba-ccc5-4679-a0ce-beaaecddd419 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:12.651091 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-376c01ba-ccc5-4679-a0ce-beaaecddd419 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:12.651517 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-376c01ba-ccc5-4679-a0ce-beaaecddd419 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:12.665112 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.wsgi [None req-376c01ba-ccc5-4679-a0ce-beaaecddd419 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] HTTP exception thrown: Instance 033d7c0c-b5ff-43bb-995d-500a2c087f7d could not be found. Aug 12 01:33:12.666789 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-376c01ba-ccc5-4679-a0ce-beaaecddd419 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Request method failure captured: Aug 12 01:33:12.666789 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: request: GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d HTTP/1.1 Aug 12 01:33:12.666789 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept: application/json Aug 12 01:33:12.666789 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept-Encoding: identity Aug 12 01:33:12.666789 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Connection: close Aug 12 01:33:12.666789 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Length: 0 Aug 12 01:33:12.666789 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Type: application/json Aug 12 01:33:12.666789 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Host: 10.222.0.20 Aug 12 01:33:12.666789 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Openstack-System-Scope: None Aug 12 01:33:12.666789 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: User-Agent: python-urllib3/1.26.11 Aug 12 01:33:12.666789 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Auth-Token: gAAAAABi9aysta1ExUaxXxQ9rYnSUQP7esxJrZzjQTGP-Rx-1mSW3FSa4Ni1V3s1gY-bX9pmoxF8Imm85iSgEmyp6i7Om1zZCTrheGnqYhUdvsswrsrCeMS3azlEhIm0ZDa-UZ_XH6zsXrFWA97-e9Lhn4LyTV3IcnRq62-QuKU-oVMmx5EzFRU Aug 12 01:33:12.666789 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Id: None Aug 12 01:33:12.666789 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Name: None Aug 12 01:33:12.666789 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Identity-Status: Confirmed Aug 12 01:33:12.666789 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Is-Admin-Project: True Aug 12 01:33:12.666789 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Id: default Aug 12 01:33:12.666789 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Name: Default Aug 12 01:33:12.666789 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Id: e5e2fd72103c4b5e956ef5b9c291f16d Aug 12 01:33:12.666789 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:33:12.666789 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Role: member,reader Aug 12 01:33:12.666789 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Roles: member,reader Aug 12 01:33:12.668251 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e5e2fd72103c4b5e956ef5b9c291f16d"}]}] Aug 12 01:33:12.668251 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:33:12.668251 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Id: e5e2fd72103c4b5e956ef5b9c291f16d Aug 12 01:33:12.668251 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:33:12.668251 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User: tempest-AttachVolumeNegativeTest-2079581927-project Aug 12 01:33:12.668251 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Id: default Aug 12 01:33:12.668251 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Name: Default Aug 12 01:33:12.668251 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Id: 4395876e1de944ae82d23d43a30a82a8 Aug 12 01:33:12.668251 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Name: tempest-AttachVolumeNegativeTest-2079581927-project Aug 12 01:33:12.668251 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: method: > Aug 12 01:33:12.668251 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: exception: Instance 033d7c0c-b5ff-43bb-995d-500a2c087f7d could not be found. Aug 12 01:33:12.668251 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: action_args: {'id': '033d7c0c-b5ff-43bb-995d-500a2c087f7d'} Aug 12 01:33:12.669126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:33:12.669126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:33:12.669126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:33:12.669126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:33:12.669126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:33:12.669126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:33:12.669126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:33:12.669126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:33:12.669126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:33:12.669126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:33:12.669126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 033d7c0c-b5ff-43bb-995d-500a2c087f7d could not be found. Aug 12 01:33:12.669126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:33:12.669126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:33:12.669126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:33:12.669126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:33:12.669126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:33:12.669126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:33:12.669126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:33:12.669126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:33:12.669126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:33:12.670520 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:33:12.670520 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 01:33:12.670520 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 01:33:12.670520 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:33:12.670520 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:33:12.670520 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:33:12.670520 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:33:12.670520 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 033d7c0c-b5ff-43bb-995d-500a2c087f7d could not be found. Aug 12 01:33:12.670520 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:33:12.670520 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:33:12.670520 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:33:12.670520 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:33:12.670520 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:33:12.670520 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:33:12.670520 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:33:12.670520 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:33:12.670520 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 033d7c0c-b5ff-43bb-995d-500a2c087f7d could not be found. Aug 12 01:33:12.670520 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:33:12.671807 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-376c01ba-ccc5-4679-a0ce-beaaecddd419 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Returning 404 to user: Instance 033d7c0c-b5ff-43bb-995d-500a2c087f7d could not be found. {{(pid=120786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:33:12.671807 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-376c01ba-ccc5-4679-a0ce-beaaecddd419 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d" status: 404 len: 111 microversion: 2.1 time: 0.030959 Aug 12 01:33:12.671807 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 361/716] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:12 2022] GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:33:12.677772 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-41d7ed04-51ce-44a1-80c3-47561b308494 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '.version_select at 0x7f2dece55310>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:12.701862 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-41d7ed04-51ce-44a1-80c3-47561b308494 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1352366985" status: 202 len: 0 microversion: 2.1 time: 0.028073 Aug 12 01:33:12.702801 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 356/717] 10.222.0.20 () {58 vars in 1221 bytes} [Fri Aug 12 01:33:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1352366985 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 01:33:13.012463 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-6dc9ea34-539b-4c6e-94ac-dc76201d4db3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:13.013059 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-6dc9ea34-539b-4c6e-94ac-dc76201d4db3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: e61e785b-aa63-4b29-b82d-185988c73bc1] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:13.019845 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6dc9ea34-539b-4c6e-94ac-dc76201d4db3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:13.020334 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6dc9ea34-539b-4c6e-94ac-dc76201d4db3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:13.020771 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6dc9ea34-539b-4c6e-94ac-dc76201d4db3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:13.021475 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6dc9ea34-539b-4c6e-94ac-dc76201d4db3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:13.021951 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6dc9ea34-539b-4c6e-94ac-dc76201d4db3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:13.022377 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6dc9ea34-539b-4c6e-94ac-dc76201d4db3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:13.160189 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-6dc9ea34-539b-4c6e-94ac-dc76201d4db3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:13.168682 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-6dc9ea34-539b-4c6e-94ac-dc76201d4db3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1" status: 200 len: 1264 microversion: 2.1 time: 0.160288 Aug 12 01:33:13.169359 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 362/718] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:13 2022] GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:13.506851 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-8d311f2b-0939-48d9-83a4-33290a705a9c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:13.507471 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-8d311f2b-0939-48d9-83a4-33290a705a9c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:13.514464 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8d311f2b-0939-48d9-83a4-33290a705a9c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:13.514964 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8d311f2b-0939-48d9-83a4-33290a705a9c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:13.515391 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8d311f2b-0939-48d9-83a4-33290a705a9c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:13.516132 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8d311f2b-0939-48d9-83a4-33290a705a9c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:13.516671 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8d311f2b-0939-48d9-83a4-33290a705a9c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:13.517090 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8d311f2b-0939-48d9-83a4-33290a705a9c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:13.544962 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-8d311f2b-0939-48d9-83a4-33290a705a9c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Going to try to terminate instance {{(pid=120785) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 01:33:13.632638 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-8d311f2b-0939-48d9-83a4-33290a705a9c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 204 len: 0 microversion: 2.1 time: 0.129487 Aug 12 01:33:13.633524 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 357/719] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 01:33:13 2022] DELETE /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 01:33:13.642052 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-504b0e95-1d7c-4aa6-b01d-c5929f89ade1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:13.642825 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-504b0e95-1d7c-4aa6-b01d-c5929f89ade1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:13.650121 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-504b0e95-1d7c-4aa6-b01d-c5929f89ade1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:13.653795 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-504b0e95-1d7c-4aa6-b01d-c5929f89ade1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:13.653795 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-504b0e95-1d7c-4aa6-b01d-c5929f89ade1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:13.653795 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-504b0e95-1d7c-4aa6-b01d-c5929f89ade1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:13.653795 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-504b0e95-1d7c-4aa6-b01d-c5929f89ade1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:13.654209 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-504b0e95-1d7c-4aa6-b01d-c5929f89ade1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:13.794988 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-504b0e95-1d7c-4aa6-b01d-c5929f89ade1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:13.802615 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-504b0e95-1d7c-4aa6-b01d-c5929f89ade1 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1507 microversion: 2.1 time: 0.164975 Aug 12 01:33:13.803492 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 363/720] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:13 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:13.995525 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-90c436ad-120e-44cf-8db0-fa4c44e0fe94 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Action: 'create', calling method: .version_select at 0x7f2dece5da60>, body: {"keypair": {"name": "tempest-keypair-196972616", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8E0pLKfPUo74SptaANhe0xhpoKiZ3bwiYihEzvFrvSOpVzUCe56dXdHfLL/aDnMGuuhTFQkZnFZEqihJxekY6ySMCUc1cMoSC8RPnXZ+cDb+1CawOL0+vQzjC8M8jgig=="}} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:33:14.012089 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.quota [None req-90c436ad-120e-44cf-8db0-fa4c44e0fe94 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Getting quotas for project e5e2fd72103c4b5e956ef5b9c291f16d. Resources: {'key_pairs'} {{(pid=120785) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 01:33:14.016386 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.quota [None req-90c436ad-120e-44cf-8db0-fa4c44e0fe94 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Getting quotas for user 4395876e1de944ae82d23d43a30a82a8 and project e5e2fd72103c4b5e956ef5b9c291f16d. Resources: {'key_pairs'} {{(pid=120785) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 01:33:14.018413 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-1ab8cea2-e268-4889-b0d2-88cb949d5faf tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:33:14.019715 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-1ab8cea2-e268-4889-b0d2-88cb949d5faf tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:14.026731 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1ab8cea2-e268-4889-b0d2-88cb949d5faf tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:14.027215 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1ab8cea2-e268-4889-b0d2-88cb949d5faf tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:14.027693 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1ab8cea2-e268-4889-b0d2-88cb949d5faf tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:14.028390 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1ab8cea2-e268-4889-b0d2-88cb949d5faf tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:14.028840 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1ab8cea2-e268-4889-b0d2-88cb949d5faf tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:14.029261 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1ab8cea2-e268-4889-b0d2-88cb949d5faf tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:14.040870 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-90c436ad-120e-44cf-8db0-fa4c44e0fe94 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.171059 Aug 12 01:33:14.041475 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 358/721] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Aug 12 01:33:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 01:33:14.052494 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.objects.instance [None req-1ab8cea2-e268-4889-b0d2-88cb949d5faf tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lazy-loading 'flavor' on Instance uuid f3d50f7a-89e5-4250-be37-7fdf4f9b79da {{(pid=120786) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 01:33:14.190591 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-742bfb47-0442-449a-b1f7-a7d5105e8ee9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:14.191057 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-742bfb47-0442-449a-b1f7-a7d5105e8ee9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: e61e785b-aa63-4b29-b82d-185988c73bc1] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:14.202159 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-742bfb47-0442-449a-b1f7-a7d5105e8ee9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:14.202451 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-742bfb47-0442-449a-b1f7-a7d5105e8ee9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:14.203148 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-742bfb47-0442-449a-b1f7-a7d5105e8ee9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:14.204403 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-742bfb47-0442-449a-b1f7-a7d5105e8ee9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:14.205062 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-742bfb47-0442-449a-b1f7-a7d5105e8ee9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:14.205747 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-742bfb47-0442-449a-b1f7-a7d5105e8ee9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:14.234375 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-1ab8cea2-e268-4889-b0d2-88cb949d5faf tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "POST /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da/action" status: 202 len: 0 microversion: 2.20 time: 0.219742 Aug 12 01:33:14.235210 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 364/722] 10.222.0.20 () {62 vars in 1319 bytes} [Fri Aug 12 01:33:14 2022] POST /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 12 01:33:14.244286 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-297a4afd-8d59-4b47-8dac-9fe8e44eb871 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:14.245068 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-297a4afd-8d59-4b47-8dac-9fe8e44eb871 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:14.253227 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-297a4afd-8d59-4b47-8dac-9fe8e44eb871 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:14.253837 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-297a4afd-8d59-4b47-8dac-9fe8e44eb871 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:14.254346 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-297a4afd-8d59-4b47-8dac-9fe8e44eb871 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:14.255132 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-297a4afd-8d59-4b47-8dac-9fe8e44eb871 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:14.255705 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-297a4afd-8d59-4b47-8dac-9fe8e44eb871 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:14.256203 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-297a4afd-8d59-4b47-8dac-9fe8e44eb871 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:14.419010 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-742bfb47-0442-449a-b1f7-a7d5105e8ee9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:14.428430 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-742bfb47-0442-449a-b1f7-a7d5105e8ee9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1" status: 200 len: 1264 microversion: 2.1 time: 0.241911 Aug 12 01:33:14.429388 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 359/723] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:14 2022] GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1 => generated 1264 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:33:14.452440 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-297a4afd-8d59-4b47-8dac-9fe8e44eb871 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:14.461268 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-297a4afd-8d59-4b47-8dac-9fe8e44eb871 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:14.462777 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-297a4afd-8d59-4b47-8dac-9fe8e44eb871 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:14.463985 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-297a4afd-8d59-4b47-8dac-9fe8e44eb871 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1724 microversion: 2.20 time: 0.224247 Aug 12 01:33:14.464547 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 365/724] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:33:14 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:33:14.824509 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-80f7ffd0-c367-45d4-b124-69b2dd06ed9c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:14.825223 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-80f7ffd0-c367-45d4-b124-69b2dd06ed9c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:14.832286 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-80f7ffd0-c367-45d4-b124-69b2dd06ed9c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:14.833083 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-80f7ffd0-c367-45d4-b124-69b2dd06ed9c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:14.833508 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-80f7ffd0-c367-45d4-b124-69b2dd06ed9c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:14.834357 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-80f7ffd0-c367-45d4-b124-69b2dd06ed9c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:14.834983 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-80f7ffd0-c367-45d4-b124-69b2dd06ed9c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:14.835592 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-80f7ffd0-c367-45d4-b124-69b2dd06ed9c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:14.989740 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-80f7ffd0-c367-45d4-b124-69b2dd06ed9c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:14.997245 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-80f7ffd0-c367-45d4-b124-69b2dd06ed9c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1507 microversion: 2.1 time: 0.178179 Aug 12 01:33:14.998009 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 360/725] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:14 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1507 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:15.309405 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-cb7e6b89-bfbf-4878-8504-219eb86fe0c2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1340264605", "imageRef": "0d77ae04-91a5-4e2b-8817-72986618c549", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c69785c6-9bf5-4740-9585-57c14141c241"}], "security_groups": [{"name": "tempest-securitygroup--731895343"}], "key_name": "tempest-keypair-196972616", "user_data": "}} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:33:15.419007 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.network.neutron [None req-cb7e6b89-bfbf-4878-8504-219eb86fe0c2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] validate_networks() for [('c69785c6-9bf5-4740-9585-57c14141c241', None, None, None, None, None)] {{(pid=120786) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 01:33:15.450922 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-10b1f189-23ca-4549-8bc6-c6d6a164856d tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:15.451550 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-10b1f189-23ca-4549-8bc6-c6d6a164856d tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: e61e785b-aa63-4b29-b82d-185988c73bc1] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:15.458147 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-10b1f189-23ca-4549-8bc6-c6d6a164856d tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:15.458687 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-10b1f189-23ca-4549-8bc6-c6d6a164856d tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:15.459122 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-10b1f189-23ca-4549-8bc6-c6d6a164856d tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:15.459859 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-10b1f189-23ca-4549-8bc6-c6d6a164856d tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:15.460306 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-10b1f189-23ca-4549-8bc6-c6d6a164856d tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:15.460730 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-10b1f189-23ca-4549-8bc6-c6d6a164856d tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:15.670116 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-10b1f189-23ca-4549-8bc6-c6d6a164856d tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:15.679071 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-10b1f189-23ca-4549-8bc6-c6d6a164856d tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1" status: 200 len: 1264 microversion: 2.1 time: 0.232105 Aug 12 01:33:15.679659 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 361/726] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:15 2022] GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1 => generated 1264 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:15.791753 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-ee508990-675b-4185-bee7-d09a37ffa41a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:15.792637 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-ee508990-675b-4185-bee7-d09a37ffa41a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:15.798816 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ee508990-675b-4185-bee7-d09a37ffa41a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:15.799421 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ee508990-675b-4185-bee7-d09a37ffa41a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:15.799931 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ee508990-675b-4185-bee7-d09a37ffa41a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:15.800653 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ee508990-675b-4185-bee7-d09a37ffa41a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:15.801091 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ee508990-675b-4185-bee7-d09a37ffa41a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:15.801615 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ee508990-675b-4185-bee7-d09a37ffa41a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:16.248254 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-cb7e6b89-bfbf-4878-8504-219eb86fe0c2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Flavor limits 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 01:33:16.248679 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-cb7e6b89-bfbf-4878-8504-219eb86fe0c2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Image limits 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 01:33:16.249211 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-cb7e6b89-bfbf-4878-8504-219eb86fe0c2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Flavor pref 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 01:33:16.249712 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-cb7e6b89-bfbf-4878-8504-219eb86fe0c2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Image pref 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 01:33:16.250123 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-cb7e6b89-bfbf-4878-8504-219eb86fe0c2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 01:33:16.259758 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cb7e6b89-bfbf-4878-8504-219eb86fe0c2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:16.260515 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cb7e6b89-bfbf-4878-8504-219eb86fe0c2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:16.261119 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cb7e6b89-bfbf-4878-8504-219eb86fe0c2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:16.261889 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cb7e6b89-bfbf-4878-8504-219eb86fe0c2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:16.262263 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-ee508990-675b-4185-bee7-d09a37ffa41a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:16.262757 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cb7e6b89-bfbf-4878-8504-219eb86fe0c2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:16.262757 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cb7e6b89-bfbf-4878-8504-219eb86fe0c2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:16.270399 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-ee508990-675b-4185-bee7-d09a37ffa41a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:16.272295 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-ee508990-675b-4185-bee7-d09a37ffa41a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:16.273696 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-ee508990-675b-4185-bee7-d09a37ffa41a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1724 microversion: 2.20 time: 0.593109 Aug 12 01:33:16.274345 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 362/727] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:33:15 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1724 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:33:16.282808 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.quota [None req-cb7e6b89-bfbf-4878-8504-219eb86fe0c2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Getting quotas for project e5e2fd72103c4b5e956ef5b9c291f16d. Resources: {'cores', 'ram', 'instances'} {{(pid=120786) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 01:33:16.285117 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-de058a6d-1334-4f78-9a8e-f8ec6dcfd83e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:16.285851 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-de058a6d-1334-4f78-9a8e-f8ec6dcfd83e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:16.288425 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.quota [None req-cb7e6b89-bfbf-4878-8504-219eb86fe0c2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Getting quotas for user 4395876e1de944ae82d23d43a30a82a8 and project e5e2fd72103c4b5e956ef5b9c291f16d. Resources: {'cores', 'ram', 'instances'} {{(pid=120786) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 01:33:16.292380 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-de058a6d-1334-4f78-9a8e-f8ec6dcfd83e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:16.293062 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-de058a6d-1334-4f78-9a8e-f8ec6dcfd83e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:16.293498 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-de058a6d-1334-4f78-9a8e-f8ec6dcfd83e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:16.294210 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-de058a6d-1334-4f78-9a8e-f8ec6dcfd83e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:16.294655 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-de058a6d-1334-4f78-9a8e-f8ec6dcfd83e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:16.295075 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-de058a6d-1334-4f78-9a8e-f8ec6dcfd83e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:16.305213 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-cb7e6b89-bfbf-4878-8504-219eb86fe0c2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Going to run 1 instances... {{(pid=120786) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 01:33:16.307777 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-cb7e6b89-bfbf-4878-8504-219eb86fe0c2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 2bb87cca-3f2d-4017-9cb9-1f309cdaacac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d77ae04-91a5-4e2b-8817-72986618c549',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120786) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 01:33:16.398343 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-cb7e6b89-bfbf-4878-8504-219eb86fe0c2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.093117 Aug 12 01:33:16.400251 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 366/728] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 01:33:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 1096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 01:33:16.414299 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-310d086f-c266-4cd5-90ac-9815322780db tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:16.414979 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-310d086f-c266-4cd5-90ac-9815322780db tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 2bb87cca-3f2d-4017-9cb9-1f309cdaacac] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:16.430534 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-de058a6d-1334-4f78-9a8e-f8ec6dcfd83e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:16.439509 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-de058a6d-1334-4f78-9a8e-f8ec6dcfd83e tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 200 len: 1465 microversion: 2.1 time: 0.163918 Aug 12 01:33:16.440833 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 363/729] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:16 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 1465 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:16.445785 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-c9d850e8-3c58-403d-b030-07817904eafd req-fc328118-3359-4296-a51c-9aff8de1a79a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2961f2a6-2c42-46af-8a74-98a8692ef170", "name": "network-vif-deleted", "tag": "62bb6f5f-1dc9-4675-9d96-12163b24d167"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:33:16.472762 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-c9d850e8-3c58-403d-b030-07817904eafd req-fc328118-3359-4296-a51c-9aff8de1a79a service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:16.473242 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-c9d850e8-3c58-403d-b030-07817904eafd req-fc328118-3359-4296-a51c-9aff8de1a79a service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:16.473727 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-c9d850e8-3c58-403d-b030-07817904eafd req-fc328118-3359-4296-a51c-9aff8de1a79a service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:16.486588 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-310d086f-c266-4cd5-90ac-9815322780db tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:16.492660 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-c9d850e8-3c58-403d-b030-07817904eafd req-fc328118-3359-4296-a51c-9aff8de1a79a service nova] Creating event network-vif-deleted:62bb6f5f-1dc9-4675-9d96-12163b24d167 for instance 2961f2a6-2c42-46af-8a74-98a8692ef170 on hv-cinder-78481 Aug 12 01:33:16.498490 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-c9d850e8-3c58-403d-b030-07817904eafd req-fc328118-3359-4296-a51c-9aff8de1a79a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056341 Aug 12 01:33:16.499637 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 364/730] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:33:16.502959 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-310d086f-c266-4cd5-90ac-9815322780db tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac" status: 200 len: 1241 microversion: 2.1 time: 0.095245 Aug 12 01:33:16.503580 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 367/731] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:16 2022] GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac => generated 1241 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:16.702112 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-7059e7f9-9b69-4fed-9e44-fbf36cb767d6 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:16.702894 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-7059e7f9-9b69-4fed-9e44-fbf36cb767d6 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: e61e785b-aa63-4b29-b82d-185988c73bc1] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:16.712668 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7059e7f9-9b69-4fed-9e44-fbf36cb767d6 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:16.713244 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7059e7f9-9b69-4fed-9e44-fbf36cb767d6 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:16.713925 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7059e7f9-9b69-4fed-9e44-fbf36cb767d6 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:16.714734 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7059e7f9-9b69-4fed-9e44-fbf36cb767d6 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:16.715199 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7059e7f9-9b69-4fed-9e44-fbf36cb767d6 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:16.715635 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7059e7f9-9b69-4fed-9e44-fbf36cb767d6 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:16.859201 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-7059e7f9-9b69-4fed-9e44-fbf36cb767d6 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:16.867369 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-7059e7f9-9b69-4fed-9e44-fbf36cb767d6 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1" status: 200 len: 1264 microversion: 2.1 time: 0.170871 Aug 12 01:33:16.868064 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 365/732] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:16 2022] GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:17.296234 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-f9dc101e-a6e1-4f9c-8619-51342180602d tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:17.296867 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-f9dc101e-a6e1-4f9c-8619-51342180602d tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:17.303930 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f9dc101e-a6e1-4f9c-8619-51342180602d tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:17.304409 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f9dc101e-a6e1-4f9c-8619-51342180602d tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:17.304837 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f9dc101e-a6e1-4f9c-8619-51342180602d tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:17.305531 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f9dc101e-a6e1-4f9c-8619-51342180602d tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:17.305971 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f9dc101e-a6e1-4f9c-8619-51342180602d tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:17.306386 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f9dc101e-a6e1-4f9c-8619-51342180602d tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:17.443029 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-f9dc101e-a6e1-4f9c-8619-51342180602d tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:17.451227 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-f9dc101e-a6e1-4f9c-8619-51342180602d tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:17.452757 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-f9dc101e-a6e1-4f9c-8619-51342180602d tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:17.453932 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-f9dc101e-a6e1-4f9c-8619-51342180602d tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1724 microversion: 2.20 time: 0.161671 Aug 12 01:33:17.454475 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 368/733] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:33:17 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:33:17.461151 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-f0c4427b-5f44-4500-b919-3f27328deb59 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:17.461841 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-f0c4427b-5f44-4500-b919-3f27328deb59 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 2961f2a6-2c42-46af-8a74-98a8692ef170] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:17.468390 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f0c4427b-5f44-4500-b919-3f27328deb59 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:17.468936 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f0c4427b-5f44-4500-b919-3f27328deb59 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:17.469369 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f0c4427b-5f44-4500-b919-3f27328deb59 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:17.470050 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f0c4427b-5f44-4500-b919-3f27328deb59 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:17.470494 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f0c4427b-5f44-4500-b919-3f27328deb59 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:17.470906 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f0c4427b-5f44-4500-b919-3f27328deb59 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:17.485860 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.wsgi [None req-f0c4427b-5f44-4500-b919-3f27328deb59 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] HTTP exception thrown: Instance 2961f2a6-2c42-46af-8a74-98a8692ef170 could not be found. Aug 12 01:33:17.487495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-f0c4427b-5f44-4500-b919-3f27328deb59 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Request method failure captured: Aug 12 01:33:17.487495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: request: GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 HTTP/1.1 Aug 12 01:33:17.487495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept: application/json Aug 12 01:33:17.487495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept-Encoding: identity Aug 12 01:33:17.487495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Connection: close Aug 12 01:33:17.487495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Length: 0 Aug 12 01:33:17.487495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Type: application/json Aug 12 01:33:17.487495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Host: 10.222.0.20 Aug 12 01:33:17.487495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Openstack-System-Scope: None Aug 12 01:33:17.487495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: User-Agent: python-urllib3/1.26.11 Aug 12 01:33:17.487495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Auth-Token: gAAAAABi9ayoxsO4pebdlbGb3TfC7pdsTDHM0zBbhW1rROXCyh2X3MU63lrNyuI5JBIvpFkBHWmOhzN7hT_Ph2EuZvp68TczP4qOdjp2u2mGnkKXiIsRPx1ARWLioQm2PsX7zkhWbZDIo2KgE_MjWZnupOgbzAN6WD9weMJ2_q2Y0YfQ_YfoyX8 Aug 12 01:33:17.487495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Id: None Aug 12 01:33:17.487495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Name: None Aug 12 01:33:17.487495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Identity-Status: Confirmed Aug 12 01:33:17.487495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Is-Admin-Project: True Aug 12 01:33:17.487495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Id: default Aug 12 01:33:17.487495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Name: Default Aug 12 01:33:17.487495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Id: a0674e4f240748d69cc9be8fdc79ad89 Aug 12 01:33:17.487495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1607139389 Aug 12 01:33:17.487495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Role: member,reader Aug 12 01:33:17.487495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Roles: member,reader Aug 12 01:33:17.489143 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a0674e4f240748d69cc9be8fdc79ad89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0674e4f240748d69cc9be8fdc79ad89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a0674e4f240748d69cc9be8fdc79ad89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0674e4f240748d69cc9be8fdc79ad89"}]}] Aug 12 01:33:17.489143 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1607139389 Aug 12 01:33:17.489143 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Id: a0674e4f240748d69cc9be8fdc79ad89 Aug 12 01:33:17.489143 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1607139389 Aug 12 01:33:17.489143 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User: tempest-ServerRescueNegativeTestJSON-1607139389-project Aug 12 01:33:17.489143 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Id: default Aug 12 01:33:17.489143 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Name: Default Aug 12 01:33:17.489143 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Id: fed1b143e80642328bb5c7c78cacedcd Aug 12 01:33:17.489143 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1607139389-project Aug 12 01:33:17.489143 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: method: > Aug 12 01:33:17.489143 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: exception: Instance 2961f2a6-2c42-46af-8a74-98a8692ef170 could not be found. Aug 12 01:33:17.489143 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: action_args: {'id': '2961f2a6-2c42-46af-8a74-98a8692ef170'} Aug 12 01:33:17.489996 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:33:17.489996 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:33:17.489996 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:33:17.489996 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:33:17.489996 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:33:17.489996 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:33:17.489996 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:33:17.489996 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:33:17.489996 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:33:17.489996 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:33:17.489996 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2961f2a6-2c42-46af-8a74-98a8692ef170 could not be found. Aug 12 01:33:17.489996 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:33:17.489996 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:33:17.489996 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:33:17.489996 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:33:17.489996 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:33:17.489996 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:33:17.489996 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:33:17.489996 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:33:17.489996 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:33:17.491293 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:33:17.491293 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 01:33:17.491293 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 01:33:17.491293 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:33:17.491293 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:33:17.491293 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:33:17.491293 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:33:17.491293 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2961f2a6-2c42-46af-8a74-98a8692ef170 could not be found. Aug 12 01:33:17.491293 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:33:17.491293 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:33:17.491293 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:33:17.491293 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:33:17.491293 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:33:17.491293 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:33:17.491293 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:33:17.491293 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:33:17.491293 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2961f2a6-2c42-46af-8a74-98a8692ef170 could not be found. Aug 12 01:33:17.491293 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:33:17.492422 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-f0c4427b-5f44-4500-b919-3f27328deb59 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Returning 404 to user: Instance 2961f2a6-2c42-46af-8a74-98a8692ef170 could not be found. {{(pid=120785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:33:17.492422 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-f0c4427b-5f44-4500-b919-3f27328deb59 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170" status: 404 len: 111 microversion: 2.1 time: 0.031775 Aug 12 01:33:17.492422 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 366/734] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:17 2022] GET /compute/v2.1/servers/2961f2a6-2c42-46af-8a74-98a8692ef170 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:33:17.497567 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-4389c264-626e-4804-92a8-dbf5997b8249 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:17.498056 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-4389c264-626e-4804-92a8-dbf5997b8249 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 1e1a8df3-8078-437c-ab98-64d52e277263] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:17.507725 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4389c264-626e-4804-92a8-dbf5997b8249 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:17.508316 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4389c264-626e-4804-92a8-dbf5997b8249 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:17.508728 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4389c264-626e-4804-92a8-dbf5997b8249 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:17.509462 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4389c264-626e-4804-92a8-dbf5997b8249 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:17.509904 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4389c264-626e-4804-92a8-dbf5997b8249 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:17.510320 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4389c264-626e-4804-92a8-dbf5997b8249 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:17.524358 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-b5034111-b267-4a19-848c-281f947e9518 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:17.525100 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-b5034111-b267-4a19-848c-281f947e9518 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 2bb87cca-3f2d-4017-9cb9-1f309cdaacac] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:17.531692 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b5034111-b267-4a19-848c-281f947e9518 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:17.532276 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b5034111-b267-4a19-848c-281f947e9518 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:17.532772 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b5034111-b267-4a19-848c-281f947e9518 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:17.533527 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b5034111-b267-4a19-848c-281f947e9518 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:17.534037 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b5034111-b267-4a19-848c-281f947e9518 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:17.534520 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b5034111-b267-4a19-848c-281f947e9518 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:17.540006 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-4389c264-626e-4804-92a8-dbf5997b8249 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 1e1a8df3-8078-437c-ab98-64d52e277263] Going to try to terminate instance {{(pid=120786) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 01:33:17.607146 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-b5034111-b267-4a19-848c-281f947e9518 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:17.615418 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-b5034111-b267-4a19-848c-281f947e9518 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac" status: 200 len: 1293 microversion: 2.1 time: 0.095236 Aug 12 01:33:17.628626 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 367/735] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:17 2022] GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac => generated 1293 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:17.643349 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-4389c264-626e-4804-92a8-dbf5997b8249 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263" status: 204 len: 0 microversion: 2.1 time: 0.149357 Aug 12 01:33:17.644475 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 369/736] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 01:33:17 2022] DELETE /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 01:33:17.653113 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-d7d43ec7-91fb-4714-ac5e-d3327c4caa3b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:17.653837 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-d7d43ec7-91fb-4714-ac5e-d3327c4caa3b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 1e1a8df3-8078-437c-ab98-64d52e277263] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:17.660579 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d7d43ec7-91fb-4714-ac5e-d3327c4caa3b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:17.661055 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d7d43ec7-91fb-4714-ac5e-d3327c4caa3b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:17.662001 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d7d43ec7-91fb-4714-ac5e-d3327c4caa3b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:17.662704 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d7d43ec7-91fb-4714-ac5e-d3327c4caa3b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:17.663226 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d7d43ec7-91fb-4714-ac5e-d3327c4caa3b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:17.663682 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d7d43ec7-91fb-4714-ac5e-d3327c4caa3b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:17.800270 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-d7d43ec7-91fb-4714-ac5e-d3327c4caa3b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:17.808846 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-d7d43ec7-91fb-4714-ac5e-d3327c4caa3b tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263" status: 200 len: 1521 microversion: 2.1 time: 0.160087 Aug 12 01:33:17.809419 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 368/737] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:17 2022] GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:17.895194 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-18aca002-60d1-4632-b29f-e5c4c5fa0221 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:17.896279 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-18aca002-60d1-4632-b29f-e5c4c5fa0221 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: e61e785b-aa63-4b29-b82d-185988c73bc1] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:17.902450 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-18aca002-60d1-4632-b29f-e5c4c5fa0221 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:17.902922 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-18aca002-60d1-4632-b29f-e5c4c5fa0221 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:17.903351 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-18aca002-60d1-4632-b29f-e5c4c5fa0221 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:17.904074 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-18aca002-60d1-4632-b29f-e5c4c5fa0221 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:17.904514 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-18aca002-60d1-4632-b29f-e5c4c5fa0221 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:17.904924 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-18aca002-60d1-4632-b29f-e5c4c5fa0221 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:18.058077 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-18aca002-60d1-4632-b29f-e5c4c5fa0221 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:18.066209 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-18aca002-60d1-4632-b29f-e5c4c5fa0221 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1" status: 200 len: 1264 microversion: 2.1 time: 0.178517 Aug 12 01:33:18.066776 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 370/738] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:17 2022] GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1 => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:18.481117 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-b066c08f-a28e-4a46-a30f-f44832a5b066 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:18.482058 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-b066c08f-a28e-4a46-a30f-f44832a5b066 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:18.486060 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell0:SELECT=2 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:33:18.493207 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b066c08f-a28e-4a46-a30f-f44832a5b066 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:18.493703 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b066c08f-a28e-4a46-a30f-f44832a5b066 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:18.494134 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b066c08f-a28e-4a46-a30f-f44832a5b066 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:18.494852 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b066c08f-a28e-4a46-a30f-f44832a5b066 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:18.495298 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b066c08f-a28e-4a46-a30f-f44832a5b066 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:18.495786 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b066c08f-a28e-4a46-a30f-f44832a5b066 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:18.637967 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-5a57274f-df8e-442e-9bb0-5cd5e532a77c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:18.638578 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-5a57274f-df8e-442e-9bb0-5cd5e532a77c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 2bb87cca-3f2d-4017-9cb9-1f309cdaacac] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:18.638685 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-b066c08f-a28e-4a46-a30f-f44832a5b066 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:18.645329 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5a57274f-df8e-442e-9bb0-5cd5e532a77c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:18.645924 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5a57274f-df8e-442e-9bb0-5cd5e532a77c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:18.646359 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5a57274f-df8e-442e-9bb0-5cd5e532a77c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:18.646740 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-b066c08f-a28e-4a46-a30f-f44832a5b066 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:18.647058 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5a57274f-df8e-442e-9bb0-5cd5e532a77c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:18.647552 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5a57274f-df8e-442e-9bb0-5cd5e532a77c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:18.647965 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5a57274f-df8e-442e-9bb0-5cd5e532a77c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:18.648267 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-b066c08f-a28e-4a46-a30f-f44832a5b066 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:18.649427 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-b066c08f-a28e-4a46-a30f-f44832a5b066 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1724 microversion: 2.20 time: 0.175169 Aug 12 01:33:18.650045 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 369/739] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:33:18 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:33:18.720185 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-5a57274f-df8e-442e-9bb0-5cd5e532a77c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:18.731190 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-5a57274f-df8e-442e-9bb0-5cd5e532a77c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac" status: 200 len: 1311 microversion: 2.1 time: 0.096846 Aug 12 01:33:18.732073 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 371/740] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:18 2022] GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:18.829439 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-58c67f9a-30af-4773-af1a-18552dc4716c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:18.830045 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-58c67f9a-30af-4773-af1a-18552dc4716c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 1e1a8df3-8078-437c-ab98-64d52e277263] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:18.836705 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-58c67f9a-30af-4773-af1a-18552dc4716c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:18.837183 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-58c67f9a-30af-4773-af1a-18552dc4716c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:18.837606 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-58c67f9a-30af-4773-af1a-18552dc4716c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:18.838282 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-58c67f9a-30af-4773-af1a-18552dc4716c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:18.838727 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-58c67f9a-30af-4773-af1a-18552dc4716c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:18.839142 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-58c67f9a-30af-4773-af1a-18552dc4716c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:18.976051 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-58c67f9a-30af-4773-af1a-18552dc4716c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:18.984392 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-58c67f9a-30af-4773-af1a-18552dc4716c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263" status: 200 len: 1521 microversion: 2.1 time: 0.158828 Aug 12 01:33:18.984980 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 370/741] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:18 2022] GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:19.091047 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-582e4521-a737-4a89-93e5-44e29d8f20b4 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:19.092048 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-582e4521-a737-4a89-93e5-44e29d8f20b4 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: e61e785b-aa63-4b29-b82d-185988c73bc1] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:19.101060 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-582e4521-a737-4a89-93e5-44e29d8f20b4 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:19.101539 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-582e4521-a737-4a89-93e5-44e29d8f20b4 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:19.101967 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-582e4521-a737-4a89-93e5-44e29d8f20b4 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:19.102653 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-582e4521-a737-4a89-93e5-44e29d8f20b4 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:19.103094 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-582e4521-a737-4a89-93e5-44e29d8f20b4 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:19.103504 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-582e4521-a737-4a89-93e5-44e29d8f20b4 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:19.122573 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:33:19.241469 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-582e4521-a737-4a89-93e5-44e29d8f20b4 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:19.249496 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-582e4521-a737-4a89-93e5-44e29d8f20b4 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1" status: 200 len: 1264 microversion: 2.1 time: 0.164980 Aug 12 01:33:19.250096 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 372/742] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:19 2022] GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:19.677134 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-63d58b44-b010-4df6-a334-60b83fbdc9ab tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:19.678559 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-63d58b44-b010-4df6-a334-60b83fbdc9ab tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:19.689506 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-63d58b44-b010-4df6-a334-60b83fbdc9ab tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:19.690287 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-63d58b44-b010-4df6-a334-60b83fbdc9ab tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:19.691000 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-63d58b44-b010-4df6-a334-60b83fbdc9ab tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:19.692189 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-63d58b44-b010-4df6-a334-60b83fbdc9ab tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:19.692913 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-63d58b44-b010-4df6-a334-60b83fbdc9ab tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:19.693611 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-63d58b44-b010-4df6-a334-60b83fbdc9ab tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:19.756312 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-be0d804c-798a-4857-b35a-c72f2e08e8c8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:19.756903 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-be0d804c-798a-4857-b35a-c72f2e08e8c8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 2bb87cca-3f2d-4017-9cb9-1f309cdaacac] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:19.764067 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-be0d804c-798a-4857-b35a-c72f2e08e8c8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:19.764554 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-be0d804c-798a-4857-b35a-c72f2e08e8c8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:19.765080 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-be0d804c-798a-4857-b35a-c72f2e08e8c8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:19.766333 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-be0d804c-798a-4857-b35a-c72f2e08e8c8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:19.767204 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-be0d804c-798a-4857-b35a-c72f2e08e8c8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:19.768048 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-be0d804c-798a-4857-b35a-c72f2e08e8c8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:19.838294 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-be0d804c-798a-4857-b35a-c72f2e08e8c8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:19.845850 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-be0d804c-798a-4857-b35a-c72f2e08e8c8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac" status: 200 len: 1311 microversion: 2.1 time: 0.093661 Aug 12 01:33:19.846669 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 373/743] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:19 2022] GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac => generated 1311 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:33:19.859961 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-63d58b44-b010-4df6-a334-60b83fbdc9ab tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:19.868212 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-63d58b44-b010-4df6-a334-60b83fbdc9ab tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:19.869709 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-63d58b44-b010-4df6-a334-60b83fbdc9ab tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:19.870879 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-63d58b44-b010-4df6-a334-60b83fbdc9ab tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1724 microversion: 2.20 time: 0.200521 Aug 12 01:33:19.871454 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 371/744] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:33:19 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:33:20.009185 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-cee2ba8d-1f0c-4991-b65c-f68522de884c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:20.009939 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-cee2ba8d-1f0c-4991-b65c-f68522de884c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 1e1a8df3-8078-437c-ab98-64d52e277263] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:20.018598 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cee2ba8d-1f0c-4991-b65c-f68522de884c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:20.019189 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cee2ba8d-1f0c-4991-b65c-f68522de884c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:20.019769 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cee2ba8d-1f0c-4991-b65c-f68522de884c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:20.020621 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cee2ba8d-1f0c-4991-b65c-f68522de884c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:20.021213 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cee2ba8d-1f0c-4991-b65c-f68522de884c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:20.021734 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cee2ba8d-1f0c-4991-b65c-f68522de884c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:20.174715 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-cee2ba8d-1f0c-4991-b65c-f68522de884c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:20.183333 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-cee2ba8d-1f0c-4991-b65c-f68522de884c tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263" status: 200 len: 1521 microversion: 2.1 time: 0.180843 Aug 12 01:33:20.183971 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 374/745] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:20 2022] GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:20.274272 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-a7d78bd4-d978-428f-8ee0-9ee54ad1d305 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:20.275136 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-a7d78bd4-d978-428f-8ee0-9ee54ad1d305 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: e61e785b-aa63-4b29-b82d-185988c73bc1] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:20.285209 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a7d78bd4-d978-428f-8ee0-9ee54ad1d305 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:20.286009 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a7d78bd4-d978-428f-8ee0-9ee54ad1d305 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:20.286953 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a7d78bd4-d978-428f-8ee0-9ee54ad1d305 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:20.288145 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a7d78bd4-d978-428f-8ee0-9ee54ad1d305 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:20.288947 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a7d78bd4-d978-428f-8ee0-9ee54ad1d305 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:20.289653 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a7d78bd4-d978-428f-8ee0-9ee54ad1d305 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:20.422951 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-a7d78bd4-d978-428f-8ee0-9ee54ad1d305 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:20.428443 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:33:20.434855 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-a7d78bd4-d978-428f-8ee0-9ee54ad1d305 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1" status: 200 len: 1264 microversion: 2.1 time: 0.166801 Aug 12 01:33:20.435610 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 372/746] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:20 2022] GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:20.866657 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-d7655785-3db3-47d4-8487-7c03e2b1927b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:20.867420 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-d7655785-3db3-47d4-8487-7c03e2b1927b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 2bb87cca-3f2d-4017-9cb9-1f309cdaacac] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:20.874112 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d7655785-3db3-47d4-8487-7c03e2b1927b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:20.874682 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d7655785-3db3-47d4-8487-7c03e2b1927b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:20.875176 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d7655785-3db3-47d4-8487-7c03e2b1927b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:20.875950 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d7655785-3db3-47d4-8487-7c03e2b1927b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:20.876461 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d7655785-3db3-47d4-8487-7c03e2b1927b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:20.876905 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d7655785-3db3-47d4-8487-7c03e2b1927b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:20.894367 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-bcf26150-8de0-4027-bb78-90a2d61d3fae tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:20.894991 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-bcf26150-8de0-4027-bb78-90a2d61d3fae tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:20.902573 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bcf26150-8de0-4027-bb78-90a2d61d3fae tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:20.903173 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bcf26150-8de0-4027-bb78-90a2d61d3fae tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:20.903660 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bcf26150-8de0-4027-bb78-90a2d61d3fae tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:20.904346 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bcf26150-8de0-4027-bb78-90a2d61d3fae tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:20.904801 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bcf26150-8de0-4027-bb78-90a2d61d3fae tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:20.905217 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bcf26150-8de0-4027-bb78-90a2d61d3fae tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:20.945560 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-d7655785-3db3-47d4-8487-7c03e2b1927b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:20.953228 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-d7655785-3db3-47d4-8487-7c03e2b1927b tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac" status: 200 len: 1299 microversion: 2.1 time: 0.090527 Aug 12 01:33:20.953823 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 375/747] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:20 2022] GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac => generated 1299 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:21.036881 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-bcf26150-8de0-4027-bb78-90a2d61d3fae tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:21.045288 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-bcf26150-8de0-4027-bb78-90a2d61d3fae tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:21.046771 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-bcf26150-8de0-4027-bb78-90a2d61d3fae tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:21.047955 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-bcf26150-8de0-4027-bb78-90a2d61d3fae tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1724 microversion: 2.20 time: 0.158178 Aug 12 01:33:21.048508 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 373/748] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:33:20 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:33:21.208445 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-a9c84b71-bc56-42a4-a151-6cef63a350b5 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:21.209454 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-a9c84b71-bc56-42a4-a151-6cef63a350b5 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 1e1a8df3-8078-437c-ab98-64d52e277263] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:21.219662 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a9c84b71-bc56-42a4-a151-6cef63a350b5 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:21.220473 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a9c84b71-bc56-42a4-a151-6cef63a350b5 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:21.221200 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a9c84b71-bc56-42a4-a151-6cef63a350b5 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:21.222342 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a9c84b71-bc56-42a4-a151-6cef63a350b5 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:21.223094 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a9c84b71-bc56-42a4-a151-6cef63a350b5 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:21.223890 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a9c84b71-bc56-42a4-a151-6cef63a350b5 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:21.364667 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-a9c84b71-bc56-42a4-a151-6cef63a350b5 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:21.372356 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-a9c84b71-bc56-42a4-a151-6cef63a350b5 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263" status: 200 len: 1521 microversion: 2.1 time: 0.170464 Aug 12 01:33:21.372952 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 376/749] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:21 2022] GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:21.459995 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-090fd8ae-4d72-48b3-a2ac-9d00ce5158ea tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:21.460745 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-090fd8ae-4d72-48b3-a2ac-9d00ce5158ea tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: e61e785b-aa63-4b29-b82d-185988c73bc1] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:21.468736 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-090fd8ae-4d72-48b3-a2ac-9d00ce5158ea tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:21.469217 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-090fd8ae-4d72-48b3-a2ac-9d00ce5158ea tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:21.469626 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-090fd8ae-4d72-48b3-a2ac-9d00ce5158ea tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:21.470324 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-090fd8ae-4d72-48b3-a2ac-9d00ce5158ea tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:21.470764 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-090fd8ae-4d72-48b3-a2ac-9d00ce5158ea tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:21.471177 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-090fd8ae-4d72-48b3-a2ac-9d00ce5158ea tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:21.609336 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-090fd8ae-4d72-48b3-a2ac-9d00ce5158ea tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:21.617028 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-090fd8ae-4d72-48b3-a2ac-9d00ce5158ea tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1" status: 200 len: 1264 microversion: 2.1 time: 0.162252 Aug 12 01:33:21.617616 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 374/750] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:21 2022] GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:21.974418 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-a9531fd4-f41c-4563-a9be-3d8508d07a61 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:21.975024 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-a9531fd4-f41c-4563-a9be-3d8508d07a61 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 2bb87cca-3f2d-4017-9cb9-1f309cdaacac] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:21.981794 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a9531fd4-f41c-4563-a9be-3d8508d07a61 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:21.982396 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a9531fd4-f41c-4563-a9be-3d8508d07a61 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:21.982830 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a9531fd4-f41c-4563-a9be-3d8508d07a61 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:21.983540 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a9531fd4-f41c-4563-a9be-3d8508d07a61 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:21.983995 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a9531fd4-f41c-4563-a9be-3d8508d07a61 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:21.984411 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a9531fd4-f41c-4563-a9be-3d8508d07a61 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:22.046856 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-a9531fd4-f41c-4563-a9be-3d8508d07a61 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:22.055928 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-a9531fd4-f41c-4563-a9be-3d8508d07a61 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac" status: 200 len: 1299 microversion: 2.1 time: 0.085388 Aug 12 01:33:22.056533 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 377/751] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:21 2022] GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac => generated 1299 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:22.070964 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-9729b7e9-e061-4425-b03d-3b70716a549e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:22.071803 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-9729b7e9-e061-4425-b03d-3b70716a549e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:22.078930 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9729b7e9-e061-4425-b03d-3b70716a549e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:22.079492 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9729b7e9-e061-4425-b03d-3b70716a549e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:22.080074 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9729b7e9-e061-4425-b03d-3b70716a549e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:22.080974 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9729b7e9-e061-4425-b03d-3b70716a549e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:22.081749 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9729b7e9-e061-4425-b03d-3b70716a549e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:22.082191 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9729b7e9-e061-4425-b03d-3b70716a549e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:22.214558 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-ffc80493-ef18-470b-8c2d-6336510f7be7 req-db7834d0-a552-45e2-a505-f363891020ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e1a8df3-8078-437c-ab98-64d52e277263", "name": "network-vif-deleted", "tag": "f387b69c-4056-4801-b83e-52cf09447e9f"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:33:22.225843 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-ffc80493-ef18-470b-8c2d-6336510f7be7 req-db7834d0-a552-45e2-a505-f363891020ba service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:22.226525 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-ffc80493-ef18-470b-8c2d-6336510f7be7 req-db7834d0-a552-45e2-a505-f363891020ba service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:22.227173 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-ffc80493-ef18-470b-8c2d-6336510f7be7 req-db7834d0-a552-45e2-a505-f363891020ba service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:22.244585 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-9729b7e9-e061-4425-b03d-3b70716a549e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:22.245186 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-ffc80493-ef18-470b-8c2d-6336510f7be7 req-db7834d0-a552-45e2-a505-f363891020ba service nova] Creating event network-vif-deleted:f387b69c-4056-4801-b83e-52cf09447e9f for instance 1e1a8df3-8078-437c-ab98-64d52e277263 on hv-cinder-78481 Aug 12 01:33:22.251861 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-ffc80493-ef18-470b-8c2d-6336510f7be7 req-db7834d0-a552-45e2-a505-f363891020ba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042301 Aug 12 01:33:22.252690 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 378/752] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:33:22.269577 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-9729b7e9-e061-4425-b03d-3b70716a549e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:22.274758 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-9729b7e9-e061-4425-b03d-3b70716a549e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:22.279229 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-9729b7e9-e061-4425-b03d-3b70716a549e tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1724 microversion: 2.20 time: 0.209251 Aug 12 01:33:22.283404 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 375/753] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:33:22 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:33:22.394439 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-80d87074-74d6-4ced-b98d-2752ae3500d6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:22.395139 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-80d87074-74d6-4ced-b98d-2752ae3500d6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 1e1a8df3-8078-437c-ab98-64d52e277263] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:22.405243 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-80d87074-74d6-4ced-b98d-2752ae3500d6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:22.405764 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-80d87074-74d6-4ced-b98d-2752ae3500d6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:22.406381 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-80d87074-74d6-4ced-b98d-2752ae3500d6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:22.407095 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-80d87074-74d6-4ced-b98d-2752ae3500d6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:22.407707 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-80d87074-74d6-4ced-b98d-2752ae3500d6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:22.408141 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-80d87074-74d6-4ced-b98d-2752ae3500d6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:22.441314 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-80d87074-74d6-4ced-b98d-2752ae3500d6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:22.441796 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-80d87074-74d6-4ced-b98d-2752ae3500d6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:22.442415 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-80d87074-74d6-4ced-b98d-2752ae3500d6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:22.443037 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.objects.instance [None req-80d87074-74d6-4ced-b98d-2752ae3500d6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lazy-loading 'fault' on Instance uuid 1e1a8df3-8078-437c-ab98-64d52e277263 {{(pid=120786) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 01:33:22.493112 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-80d87074-74d6-4ced-b98d-2752ae3500d6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed1b143e80642328bb5c7c78cacedcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0674e4f240748d69cc9be8fdc79ad89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:22.502546 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-80d87074-74d6-4ced-b98d-2752ae3500d6 tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263" status: 200 len: 1311 microversion: 2.1 time: 0.112796 Aug 12 01:33:22.512519 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 379/754] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:22 2022] GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263 => generated 1311 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:22.639478 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-8376c4a2-b369-4f00-9ec6-9cdc0c78be93 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:22.640835 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-8376c4a2-b369-4f00-9ec6-9cdc0c78be93 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: e61e785b-aa63-4b29-b82d-185988c73bc1] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:22.647787 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8376c4a2-b369-4f00-9ec6-9cdc0c78be93 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:22.648344 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8376c4a2-b369-4f00-9ec6-9cdc0c78be93 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:22.648993 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8376c4a2-b369-4f00-9ec6-9cdc0c78be93 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:22.649854 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8376c4a2-b369-4f00-9ec6-9cdc0c78be93 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:22.650296 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8376c4a2-b369-4f00-9ec6-9cdc0c78be93 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:22.650706 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-8376c4a2-b369-4f00-9ec6-9cdc0c78be93 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:22.796369 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-8376c4a2-b369-4f00-9ec6-9cdc0c78be93 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:22.804424 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-8376c4a2-b369-4f00-9ec6-9cdc0c78be93 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1" status: 200 len: 1264 microversion: 2.1 time: 0.169846 Aug 12 01:33:22.804996 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 376/755] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:22 2022] GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:23.077098 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-0977e644-42a7-4013-b742-937d0525e992 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:23.077670 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-0977e644-42a7-4013-b742-937d0525e992 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 2bb87cca-3f2d-4017-9cb9-1f309cdaacac] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:23.084347 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0977e644-42a7-4013-b742-937d0525e992 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:23.084821 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0977e644-42a7-4013-b742-937d0525e992 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:23.085248 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0977e644-42a7-4013-b742-937d0525e992 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:23.086012 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0977e644-42a7-4013-b742-937d0525e992 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:23.086392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0977e644-42a7-4013-b742-937d0525e992 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:23.086810 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0977e644-42a7-4013-b742-937d0525e992 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:23.218014 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-0977e644-42a7-4013-b742-937d0525e992 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:23.225719 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-0977e644-42a7-4013-b742-937d0525e992 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac" status: 200 len: 1366 microversion: 2.1 time: 0.152615 Aug 12 01:33:23.226292 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 380/756] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:23 2022] GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:23.304042 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-4db670e6-5225-48a2-98d7-18c7b0f538ee tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:23.304635 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-4db670e6-5225-48a2-98d7-18c7b0f538ee tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:23.311401 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4db670e6-5225-48a2-98d7-18c7b0f538ee tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:23.311965 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4db670e6-5225-48a2-98d7-18c7b0f538ee tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:23.312400 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4db670e6-5225-48a2-98d7-18c7b0f538ee tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:23.313125 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4db670e6-5225-48a2-98d7-18c7b0f538ee tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:23.313580 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4db670e6-5225-48a2-98d7-18c7b0f538ee tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:23.314002 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4db670e6-5225-48a2-98d7-18c7b0f538ee tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:23.450451 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-4db670e6-5225-48a2-98d7-18c7b0f538ee tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:23.458667 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-4db670e6-5225-48a2-98d7-18c7b0f538ee tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:23.460215 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-4db670e6-5225-48a2-98d7-18c7b0f538ee tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:23.461387 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-4db670e6-5225-48a2-98d7-18c7b0f538ee tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1724 microversion: 2.20 time: 0.161690 Aug 12 01:33:23.461957 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 377/757] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:33:23 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:33:23.524003 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-ff2f77bf-092b-4d6e-b167-c73763824dec tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:23.524753 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-ff2f77bf-092b-4d6e-b167-c73763824dec tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] [instance: 1e1a8df3-8078-437c-ab98-64d52e277263] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:23.531611 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ff2f77bf-092b-4d6e-b167-c73763824dec tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:23.532100 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ff2f77bf-092b-4d6e-b167-c73763824dec tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:23.532537 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ff2f77bf-092b-4d6e-b167-c73763824dec tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:23.533266 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ff2f77bf-092b-4d6e-b167-c73763824dec tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:23.533763 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ff2f77bf-092b-4d6e-b167-c73763824dec tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:23.534185 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ff2f77bf-092b-4d6e-b167-c73763824dec tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:23.547961 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.wsgi [None req-ff2f77bf-092b-4d6e-b167-c73763824dec tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] HTTP exception thrown: Instance 1e1a8df3-8078-437c-ab98-64d52e277263 could not be found. Aug 12 01:33:23.549729 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-ff2f77bf-092b-4d6e-b167-c73763824dec tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Request method failure captured: Aug 12 01:33:23.549729 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: request: GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263 HTTP/1.1 Aug 12 01:33:23.549729 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept: application/json Aug 12 01:33:23.549729 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept-Encoding: identity Aug 12 01:33:23.549729 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Connection: close Aug 12 01:33:23.549729 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Length: 0 Aug 12 01:33:23.549729 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Type: application/json Aug 12 01:33:23.549729 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Host: 10.222.0.20 Aug 12 01:33:23.549729 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Openstack-System-Scope: None Aug 12 01:33:23.549729 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: User-Agent: python-urllib3/1.26.11 Aug 12 01:33:23.549729 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Auth-Token: gAAAAABi9ayoxsO4pebdlbGb3TfC7pdsTDHM0zBbhW1rROXCyh2X3MU63lrNyuI5JBIvpFkBHWmOhzN7hT_Ph2EuZvp68TczP4qOdjp2u2mGnkKXiIsRPx1ARWLioQm2PsX7zkhWbZDIo2KgE_MjWZnupOgbzAN6WD9weMJ2_q2Y0YfQ_YfoyX8 Aug 12 01:33:23.549729 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Id: None Aug 12 01:33:23.549729 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Name: None Aug 12 01:33:23.549729 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Identity-Status: Confirmed Aug 12 01:33:23.549729 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Is-Admin-Project: True Aug 12 01:33:23.549729 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Id: default Aug 12 01:33:23.549729 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Name: Default Aug 12 01:33:23.549729 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Id: a0674e4f240748d69cc9be8fdc79ad89 Aug 12 01:33:23.549729 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1607139389 Aug 12 01:33:23.549729 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Role: member,reader Aug 12 01:33:23.549729 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Roles: member,reader Aug 12 01:33:23.551234 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a0674e4f240748d69cc9be8fdc79ad89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0674e4f240748d69cc9be8fdc79ad89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a0674e4f240748d69cc9be8fdc79ad89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a0674e4f240748d69cc9be8fdc79ad89"}]}] Aug 12 01:33:23.551234 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1607139389 Aug 12 01:33:23.551234 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Id: a0674e4f240748d69cc9be8fdc79ad89 Aug 12 01:33:23.551234 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1607139389 Aug 12 01:33:23.551234 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User: tempest-ServerRescueNegativeTestJSON-1607139389-project Aug 12 01:33:23.551234 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Id: default Aug 12 01:33:23.551234 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Name: Default Aug 12 01:33:23.551234 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Id: fed1b143e80642328bb5c7c78cacedcd Aug 12 01:33:23.551234 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1607139389-project Aug 12 01:33:23.551234 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: method: > Aug 12 01:33:23.551234 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: exception: Instance 1e1a8df3-8078-437c-ab98-64d52e277263 could not be found. Aug 12 01:33:23.551234 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: action_args: {'id': '1e1a8df3-8078-437c-ab98-64d52e277263'} Aug 12 01:33:23.552142 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:33:23.552142 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:33:23.552142 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:33:23.552142 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:33:23.552142 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:33:23.552142 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:33:23.552142 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:33:23.552142 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:33:23.552142 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:33:23.552142 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:33:23.552142 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e1a8df3-8078-437c-ab98-64d52e277263 could not be found. Aug 12 01:33:23.552142 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:33:23.552142 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:33:23.552142 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:33:23.552142 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:33:23.552142 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:33:23.552142 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:33:23.552142 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:33:23.552142 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:33:23.552142 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:33:23.553895 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:33:23.553895 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 01:33:23.553895 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 01:33:23.553895 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:33:23.553895 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:33:23.553895 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:33:23.553895 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:33:23.553895 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e1a8df3-8078-437c-ab98-64d52e277263 could not be found. Aug 12 01:33:23.553895 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:33:23.553895 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:33:23.553895 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:33:23.553895 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:33:23.553895 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:33:23.553895 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:33:23.553895 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:33:23.553895 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:33:23.553895 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e1a8df3-8078-437c-ab98-64d52e277263 could not be found. Aug 12 01:33:23.553895 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:33:23.555213 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-ff2f77bf-092b-4d6e-b167-c73763824dec tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] Returning 404 to user: Instance 1e1a8df3-8078-437c-ab98-64d52e277263 could not be found. {{(pid=120786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:33:23.555213 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-ff2f77bf-092b-4d6e-b167-c73763824dec tempest-ServerRescueNegativeTestJSON-1607139389 tempest-ServerRescueNegativeTestJSON-1607139389-project] 10.222.0.20 "GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263" status: 404 len: 111 microversion: 2.1 time: 0.031564 Aug 12 01:33:23.555213 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 381/758] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:23 2022] GET /compute/v2.1/servers/1e1a8df3-8078-437c-ab98-64d52e277263 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:33:23.825030 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-7ba56916-c09f-4754-8497-b9f67a06fac0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:23.825654 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-7ba56916-c09f-4754-8497-b9f67a06fac0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: e61e785b-aa63-4b29-b82d-185988c73bc1] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:23.832123 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7ba56916-c09f-4754-8497-b9f67a06fac0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:23.832579 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7ba56916-c09f-4754-8497-b9f67a06fac0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:23.833004 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7ba56916-c09f-4754-8497-b9f67a06fac0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:23.833716 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7ba56916-c09f-4754-8497-b9f67a06fac0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:23.834177 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7ba56916-c09f-4754-8497-b9f67a06fac0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:23.834698 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7ba56916-c09f-4754-8497-b9f67a06fac0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:23.966532 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-7ba56916-c09f-4754-8497-b9f67a06fac0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:23.974314 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-7ba56916-c09f-4754-8497-b9f67a06fac0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1" status: 200 len: 1264 microversion: 2.1 time: 0.153215 Aug 12 01:33:23.975001 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 378/759] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:23 2022] GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:24.246471 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-17da2326-a149-40dc-9a43-f646bd2185b3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:24.247086 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-17da2326-a149-40dc-9a43-f646bd2185b3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 2bb87cca-3f2d-4017-9cb9-1f309cdaacac] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:24.253752 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-17da2326-a149-40dc-9a43-f646bd2185b3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:24.254230 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-17da2326-a149-40dc-9a43-f646bd2185b3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:24.254662 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-17da2326-a149-40dc-9a43-f646bd2185b3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:24.255335 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-17da2326-a149-40dc-9a43-f646bd2185b3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:24.255810 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-17da2326-a149-40dc-9a43-f646bd2185b3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:24.256226 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-17da2326-a149-40dc-9a43-f646bd2185b3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:24.270634 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-9f419f69-d601-416b-aaed-e6e48e1a299d req-1d770f26-f653-4ddf-8f32-51a1d6ee203c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bb87cca-3f2d-4017-9cb9-1f309cdaacac", "tag": "e6870c02-031d-4413-920d-dcc367128484"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:33:24.277613 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell0:SELECT=10 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:33:24.282394 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-9f419f69-d601-416b-aaed-e6e48e1a299d req-1d770f26-f653-4ddf-8f32-51a1d6ee203c service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:24.282877 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-9f419f69-d601-416b-aaed-e6e48e1a299d req-1d770f26-f653-4ddf-8f32-51a1d6ee203c service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:24.283282 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-9f419f69-d601-416b-aaed-e6e48e1a299d req-1d770f26-f653-4ddf-8f32-51a1d6ee203c service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:24.295878 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-9f419f69-d601-416b-aaed-e6e48e1a299d req-1d770f26-f653-4ddf-8f32-51a1d6ee203c service nova] Creating event network-changed:e6870c02-031d-4413-920d-dcc367128484 for instance 2bb87cca-3f2d-4017-9cb9-1f309cdaacac on hv-cinder-78481 Aug 12 01:33:24.301228 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-9f419f69-d601-416b-aaed-e6e48e1a299d req-1d770f26-f653-4ddf-8f32-51a1d6ee203c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034156 Aug 12 01:33:24.302153 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 379/760] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:33:24.394946 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-17da2326-a149-40dc-9a43-f646bd2185b3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:24.402475 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-17da2326-a149-40dc-9a43-f646bd2185b3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac" status: 200 len: 1366 microversion: 2.1 time: 0.159926 Aug 12 01:33:24.403041 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 382/761] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:24 2022] GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:24.484851 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-0fc6ca0f-db12-4df3-8315-9b225e3e7d11 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:24.485403 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-0fc6ca0f-db12-4df3-8315-9b225e3e7d11 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:24.491953 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0fc6ca0f-db12-4df3-8315-9b225e3e7d11 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:24.492429 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0fc6ca0f-db12-4df3-8315-9b225e3e7d11 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:24.492838 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0fc6ca0f-db12-4df3-8315-9b225e3e7d11 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:24.493541 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0fc6ca0f-db12-4df3-8315-9b225e3e7d11 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:24.493984 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0fc6ca0f-db12-4df3-8315-9b225e3e7d11 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:24.494395 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0fc6ca0f-db12-4df3-8315-9b225e3e7d11 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:24.631634 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-0fc6ca0f-db12-4df3-8315-9b225e3e7d11 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:24.640669 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-0fc6ca0f-db12-4df3-8315-9b225e3e7d11 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:24.642136 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-0fc6ca0f-db12-4df3-8315-9b225e3e7d11 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:24.643741 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-0fc6ca0f-db12-4df3-8315-9b225e3e7d11 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1724 microversion: 2.20 time: 0.163177 Aug 12 01:33:24.652678 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 380/762] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:33:24 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:33:25.001965 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-37fd8379-d460-4290-a65a-5bc5931d231e tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:25.003284 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-37fd8379-d460-4290-a65a-5bc5931d231e tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: e61e785b-aa63-4b29-b82d-185988c73bc1] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:25.011495 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-37fd8379-d460-4290-a65a-5bc5931d231e tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:25.012376 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-37fd8379-d460-4290-a65a-5bc5931d231e tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:25.013146 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-37fd8379-d460-4290-a65a-5bc5931d231e tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:25.014105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-37fd8379-d460-4290-a65a-5bc5931d231e tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:25.014784 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-37fd8379-d460-4290-a65a-5bc5931d231e tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:25.015439 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-37fd8379-d460-4290-a65a-5bc5931d231e tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:25.176677 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-37fd8379-d460-4290-a65a-5bc5931d231e tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:25.185421 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-37fd8379-d460-4290-a65a-5bc5931d231e tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1" status: 200 len: 1264 microversion: 2.1 time: 0.191510 Aug 12 01:33:25.186378 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 383/763] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:24 2022] GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1 => generated 1264 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:25.422931 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-d6d0415b-2e1b-4ea3-b46b-c65b177237d5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:25.423652 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-d6d0415b-2e1b-4ea3-b46b-c65b177237d5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 2bb87cca-3f2d-4017-9cb9-1f309cdaacac] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:25.430361 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d6d0415b-2e1b-4ea3-b46b-c65b177237d5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:25.430831 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d6d0415b-2e1b-4ea3-b46b-c65b177237d5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:25.431254 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d6d0415b-2e1b-4ea3-b46b-c65b177237d5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:25.431955 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d6d0415b-2e1b-4ea3-b46b-c65b177237d5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:25.432395 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d6d0415b-2e1b-4ea3-b46b-c65b177237d5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:25.432804 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d6d0415b-2e1b-4ea3-b46b-c65b177237d5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:25.581318 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-d6d0415b-2e1b-4ea3-b46b-c65b177237d5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:25.591798 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-d6d0415b-2e1b-4ea3-b46b-c65b177237d5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac" status: 200 len: 1366 microversion: 2.1 time: 0.172617 Aug 12 01:33:25.592630 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 381/764] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:25 2022] GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:25.668918 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-2a61c0b8-8d25-4d81-beff-67626d67d807 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:25.670355 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-2a61c0b8-8d25-4d81-beff-67626d67d807 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:25.680784 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2a61c0b8-8d25-4d81-beff-67626d67d807 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:25.681821 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2a61c0b8-8d25-4d81-beff-67626d67d807 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:25.682448 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2a61c0b8-8d25-4d81-beff-67626d67d807 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:25.683919 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2a61c0b8-8d25-4d81-beff-67626d67d807 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:25.684733 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2a61c0b8-8d25-4d81-beff-67626d67d807 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:25.686067 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2a61c0b8-8d25-4d81-beff-67626d67d807 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:25.825129 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-2a61c0b8-8d25-4d81-beff-67626d67d807 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:25.833964 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-2a61c0b8-8d25-4d81-beff-67626d67d807 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:25.835856 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-2a61c0b8-8d25-4d81-beff-67626d67d807 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:25.837034 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-2a61c0b8-8d25-4d81-beff-67626d67d807 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1724 microversion: 2.20 time: 0.174613 Aug 12 01:33:25.837590 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 384/765] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:33:25 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:33:26.206042 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-de8283bb-b44e-472d-9267-1461883edd6b tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:26.206651 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-de8283bb-b44e-472d-9267-1461883edd6b tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: e61e785b-aa63-4b29-b82d-185988c73bc1] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:26.209680 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:33:26.213725 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-de8283bb-b44e-472d-9267-1461883edd6b tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:26.214196 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-de8283bb-b44e-472d-9267-1461883edd6b tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:26.214628 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-de8283bb-b44e-472d-9267-1461883edd6b tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:26.215336 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-de8283bb-b44e-472d-9267-1461883edd6b tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:26.215817 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-de8283bb-b44e-472d-9267-1461883edd6b tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:26.216238 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-de8283bb-b44e-472d-9267-1461883edd6b tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:26.360504 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-de8283bb-b44e-472d-9267-1461883edd6b tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:26.368041 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-de8283bb-b44e-472d-9267-1461883edd6b tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1" status: 200 len: 1264 microversion: 2.1 time: 0.165810 Aug 12 01:33:26.368607 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 382/766] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:26 2022] GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:26.613590 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-2eb1e902-4b57-44c9-855a-1c98e26d06f2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:26.614357 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-2eb1e902-4b57-44c9-855a-1c98e26d06f2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 2bb87cca-3f2d-4017-9cb9-1f309cdaacac] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:26.617389 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell0:SELECT=2 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:33:26.618241 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell0:SELECT=10 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:33:26.622655 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2eb1e902-4b57-44c9-855a-1c98e26d06f2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:26.623511 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2eb1e902-4b57-44c9-855a-1c98e26d06f2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:26.623968 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2eb1e902-4b57-44c9-855a-1c98e26d06f2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:26.624913 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2eb1e902-4b57-44c9-855a-1c98e26d06f2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:26.625338 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2eb1e902-4b57-44c9-855a-1c98e26d06f2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:26.625747 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2eb1e902-4b57-44c9-855a-1c98e26d06f2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:26.800075 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-2eb1e902-4b57-44c9-855a-1c98e26d06f2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:26.809054 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-2eb1e902-4b57-44c9-855a-1c98e26d06f2 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac" status: 200 len: 1366 microversion: 2.1 time: 0.199358 Aug 12 01:33:26.809634 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 385/767] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:26 2022] GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:26.860810 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-86083990-1603-4a6e-bb22-9b9dac305cb8 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:26.861709 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-86083990-1603-4a6e-bb22-9b9dac305cb8 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:26.868264 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-86083990-1603-4a6e-bb22-9b9dac305cb8 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:26.868741 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-86083990-1603-4a6e-bb22-9b9dac305cb8 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:26.869171 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-86083990-1603-4a6e-bb22-9b9dac305cb8 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:26.869854 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-86083990-1603-4a6e-bb22-9b9dac305cb8 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:26.870383 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-86083990-1603-4a6e-bb22-9b9dac305cb8 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:26.870799 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-86083990-1603-4a6e-bb22-9b9dac305cb8 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:27.022500 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-86083990-1603-4a6e-bb22-9b9dac305cb8 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:27.032766 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-86083990-1603-4a6e-bb22-9b9dac305cb8 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:27.034492 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-86083990-1603-4a6e-bb22-9b9dac305cb8 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:27.036038 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-86083990-1603-4a6e-bb22-9b9dac305cb8 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1745 microversion: 2.20 time: 0.179273 Aug 12 01:33:27.036932 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 383/768] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:33:26 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1745 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:33:27.251438 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-6af6eac3-6ca4-4c7e-b667-37b5d7c52549 req-5deddaab-1dc0-45c6-9233-19940503531c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e61e785b-aa63-4b29-b82d-185988c73bc1", "name": "network-vif-plugged", "status": "completed", "tag": "7f3a189a-2823-4a1c-8884-bc1b49992c1c"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:33:27.267902 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-6af6eac3-6ca4-4c7e-b667-37b5d7c52549 req-5deddaab-1dc0-45c6-9233-19940503531c service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:27.268634 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-6af6eac3-6ca4-4c7e-b667-37b5d7c52549 req-5deddaab-1dc0-45c6-9233-19940503531c service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:27.269254 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-6af6eac3-6ca4-4c7e-b667-37b5d7c52549 req-5deddaab-1dc0-45c6-9233-19940503531c service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:27.291116 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-6af6eac3-6ca4-4c7e-b667-37b5d7c52549 req-5deddaab-1dc0-45c6-9233-19940503531c service nova] Creating event network-vif-plugged:7f3a189a-2823-4a1c-8884-bc1b49992c1c for instance e61e785b-aa63-4b29-b82d-185988c73bc1 on hv-cinder-78481 Aug 12 01:33:27.303865 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-6af6eac3-6ca4-4c7e-b667-37b5d7c52549 req-5deddaab-1dc0-45c6-9233-19940503531c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055948 Aug 12 01:33:27.305029 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 386/769] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:33:27.390482 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-32def4ba-85ca-4f6f-90c4-6f3fe6994cc1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:27.392200 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-32def4ba-85ca-4f6f-90c4-6f3fe6994cc1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: e61e785b-aa63-4b29-b82d-185988c73bc1] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:27.402821 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-32def4ba-85ca-4f6f-90c4-6f3fe6994cc1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:27.403344 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-32def4ba-85ca-4f6f-90c4-6f3fe6994cc1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:27.404182 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-32def4ba-85ca-4f6f-90c4-6f3fe6994cc1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:27.405156 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-32def4ba-85ca-4f6f-90c4-6f3fe6994cc1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:27.405850 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-32def4ba-85ca-4f6f-90c4-6f3fe6994cc1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:27.406680 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-32def4ba-85ca-4f6f-90c4-6f3fe6994cc1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:27.569909 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-32def4ba-85ca-4f6f-90c4-6f3fe6994cc1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:27.579000 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-32def4ba-85ca-4f6f-90c4-6f3fe6994cc1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1" status: 200 len: 1264 microversion: 2.1 time: 0.194409 Aug 12 01:33:27.579638 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 384/770] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:27 2022] GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1 => generated 1264 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:27.830991 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-34d6841d-c7be-4bd9-af7f-e38784a6ea58 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:27.831702 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-34d6841d-c7be-4bd9-af7f-e38784a6ea58 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 2bb87cca-3f2d-4017-9cb9-1f309cdaacac] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:27.838664 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-34d6841d-c7be-4bd9-af7f-e38784a6ea58 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:27.839144 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-34d6841d-c7be-4bd9-af7f-e38784a6ea58 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:27.839581 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-34d6841d-c7be-4bd9-af7f-e38784a6ea58 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:27.840281 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-34d6841d-c7be-4bd9-af7f-e38784a6ea58 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:27.840714 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-34d6841d-c7be-4bd9-af7f-e38784a6ea58 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:27.841130 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-34d6841d-c7be-4bd9-af7f-e38784a6ea58 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:27.981352 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-34d6841d-c7be-4bd9-af7f-e38784a6ea58 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:27.988958 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-34d6841d-c7be-4bd9-af7f-e38784a6ea58 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac" status: 200 len: 1366 microversion: 2.1 time: 0.162206 Aug 12 01:33:27.989526 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 387/771] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:27 2022] GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:28.060419 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-90982fcf-9ec9-4a78-ab70-1a73074f4cfd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:28.061036 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-90982fcf-9ec9-4a78-ab70-1a73074f4cfd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:28.067439 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-90982fcf-9ec9-4a78-ab70-1a73074f4cfd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:28.067959 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-90982fcf-9ec9-4a78-ab70-1a73074f4cfd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:28.068389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-90982fcf-9ec9-4a78-ab70-1a73074f4cfd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:28.069078 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-90982fcf-9ec9-4a78-ab70-1a73074f4cfd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:28.069527 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-90982fcf-9ec9-4a78-ab70-1a73074f4cfd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:28.069944 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-90982fcf-9ec9-4a78-ab70-1a73074f4cfd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:28.205290 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-90982fcf-9ec9-4a78-ab70-1a73074f4cfd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:28.213368 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-90982fcf-9ec9-4a78-ab70-1a73074f4cfd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:28.214876 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-90982fcf-9ec9-4a78-ab70-1a73074f4cfd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:28.216159 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-90982fcf-9ec9-4a78-ab70-1a73074f4cfd tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1745 microversion: 2.20 time: 0.159728 Aug 12 01:33:28.216803 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 385/772] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:33:28 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:33:28.600597 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-c3c642c9-d32f-427f-b835-f6f03e0e9165 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:28.601203 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-c3c642c9-d32f-427f-b835-f6f03e0e9165 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: e61e785b-aa63-4b29-b82d-185988c73bc1] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:28.607134 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c3c642c9-d32f-427f-b835-f6f03e0e9165 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:28.607665 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c3c642c9-d32f-427f-b835-f6f03e0e9165 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:28.608062 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c3c642c9-d32f-427f-b835-f6f03e0e9165 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:28.608946 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c3c642c9-d32f-427f-b835-f6f03e0e9165 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:28.609395 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c3c642c9-d32f-427f-b835-f6f03e0e9165 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:28.609815 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c3c642c9-d32f-427f-b835-f6f03e0e9165 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:28.750402 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-c3c642c9-d32f-427f-b835-f6f03e0e9165 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:28.758513 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-c3c642c9-d32f-427f-b835-f6f03e0e9165 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1" status: 200 len: 1264 microversion: 2.1 time: 0.161696 Aug 12 01:33:28.759087 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 388/773] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:28 2022] GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:33:29.009371 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-271db9e8-c83d-4f67-9548-29ca724a367a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:29.010016 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-271db9e8-c83d-4f67-9548-29ca724a367a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 2bb87cca-3f2d-4017-9cb9-1f309cdaacac] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:29.017640 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-271db9e8-c83d-4f67-9548-29ca724a367a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:29.018068 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-271db9e8-c83d-4f67-9548-29ca724a367a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:29.018503 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-271db9e8-c83d-4f67-9548-29ca724a367a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:29.019401 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-271db9e8-c83d-4f67-9548-29ca724a367a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:29.019882 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-271db9e8-c83d-4f67-9548-29ca724a367a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:29.020304 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-271db9e8-c83d-4f67-9548-29ca724a367a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:29.160007 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-271db9e8-c83d-4f67-9548-29ca724a367a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:29.168485 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-271db9e8-c83d-4f67-9548-29ca724a367a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac" status: 200 len: 1366 microversion: 2.1 time: 0.163040 Aug 12 01:33:29.169074 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 386/774] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:29 2022] GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:29.245626 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-d539b24c-8aca-45a8-9458-748898332b38 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:29.246818 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-d539b24c-8aca-45a8-9458-748898332b38 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:29.258963 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d539b24c-8aca-45a8-9458-748898332b38 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:29.259585 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d539b24c-8aca-45a8-9458-748898332b38 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:29.260380 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d539b24c-8aca-45a8-9458-748898332b38 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:29.261553 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d539b24c-8aca-45a8-9458-748898332b38 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:29.262340 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d539b24c-8aca-45a8-9458-748898332b38 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:29.262835 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d539b24c-8aca-45a8-9458-748898332b38 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:29.338002 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-d93d36ad-fa0f-41ad-8613-3097e10c8e5d req-e06df283-f0a9-46d0-9ade-bdacb13c5291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bb87cca-3f2d-4017-9cb9-1f309cdaacac", "name": "network-vif-plugged", "status": "completed", "tag": "e6870c02-031d-4413-920d-dcc367128484"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:33:29.375417 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-d93d36ad-fa0f-41ad-8613-3097e10c8e5d req-e06df283-f0a9-46d0-9ade-bdacb13c5291 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:29.375930 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-d93d36ad-fa0f-41ad-8613-3097e10c8e5d req-e06df283-f0a9-46d0-9ade-bdacb13c5291 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:29.376351 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-d93d36ad-fa0f-41ad-8613-3097e10c8e5d req-e06df283-f0a9-46d0-9ade-bdacb13c5291 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:29.397012 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-d93d36ad-fa0f-41ad-8613-3097e10c8e5d req-e06df283-f0a9-46d0-9ade-bdacb13c5291 service nova] Creating event network-vif-plugged:e6870c02-031d-4413-920d-dcc367128484 for instance 2bb87cca-3f2d-4017-9cb9-1f309cdaacac on hv-cinder-78481 Aug 12 01:33:29.405622 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-d93d36ad-fa0f-41ad-8613-3097e10c8e5d req-e06df283-f0a9-46d0-9ade-bdacb13c5291 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073387 Aug 12 01:33:29.407004 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 387/775] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:33:29.548199 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-d539b24c-8aca-45a8-9458-748898332b38 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:29.564113 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-d539b24c-8aca-45a8-9458-748898332b38 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:29.566399 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-d539b24c-8aca-45a8-9458-748898332b38 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:29.568150 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-d539b24c-8aca-45a8-9458-748898332b38 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1740 microversion: 2.20 time: 0.331108 Aug 12 01:33:29.568894 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 389/776] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:33:29 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1740 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 01:33:29.779128 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-e68d27d1-8870-415a-a6bf-ac3b74f5b1ce tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:29.779890 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-e68d27d1-8870-415a-a6bf-ac3b74f5b1ce tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: e61e785b-aa63-4b29-b82d-185988c73bc1] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:29.786728 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e68d27d1-8870-415a-a6bf-ac3b74f5b1ce tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:29.787216 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e68d27d1-8870-415a-a6bf-ac3b74f5b1ce tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:29.787828 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e68d27d1-8870-415a-a6bf-ac3b74f5b1ce tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:29.788645 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e68d27d1-8870-415a-a6bf-ac3b74f5b1ce tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:29.789101 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e68d27d1-8870-415a-a6bf-ac3b74f5b1ce tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:29.789518 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-e68d27d1-8870-415a-a6bf-ac3b74f5b1ce tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:29.932341 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-e68d27d1-8870-415a-a6bf-ac3b74f5b1ce tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:29.940186 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-e68d27d1-8870-415a-a6bf-ac3b74f5b1ce tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1" status: 200 len: 1451 microversion: 2.1 time: 0.165540 Aug 12 01:33:29.941580 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 388/777] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:29 2022] GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1 => generated 1451 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:29.960635 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-ba2452f6-25cb-4154-be7a-0b21e8244208 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:29.961543 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-ba2452f6-25cb-4154-be7a-0b21e8244208 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: e61e785b-aa63-4b29-b82d-185988c73bc1] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:29.970238 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ba2452f6-25cb-4154-be7a-0b21e8244208 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:29.970727 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ba2452f6-25cb-4154-be7a-0b21e8244208 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:29.971161 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ba2452f6-25cb-4154-be7a-0b21e8244208 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:29.971887 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ba2452f6-25cb-4154-be7a-0b21e8244208 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:29.972495 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ba2452f6-25cb-4154-be7a-0b21e8244208 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:29.973074 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ba2452f6-25cb-4154-be7a-0b21e8244208 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:30.132164 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-ba2452f6-25cb-4154-be7a-0b21e8244208 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:30.135963 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell1:SELECT=100 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:33:30.141503 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-ba2452f6-25cb-4154-be7a-0b21e8244208 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1" status: 200 len: 1451 microversion: 2.1 time: 0.184909 Aug 12 01:33:30.153240 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 390/778] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:29 2022] GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1 => generated 1451 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:30.190778 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-1a7545da-8f99-4354-bd94-477abdf785a3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:30.191393 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-1a7545da-8f99-4354-bd94-477abdf785a3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 2bb87cca-3f2d-4017-9cb9-1f309cdaacac] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:30.202269 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1a7545da-8f99-4354-bd94-477abdf785a3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:30.203130 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1a7545da-8f99-4354-bd94-477abdf785a3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:30.203850 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1a7545da-8f99-4354-bd94-477abdf785a3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:30.204949 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1a7545da-8f99-4354-bd94-477abdf785a3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:30.205615 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1a7545da-8f99-4354-bd94-477abdf785a3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:30.206256 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1a7545da-8f99-4354-bd94-477abdf785a3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:30.471293 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-1a7545da-8f99-4354-bd94-477abdf785a3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:30.481602 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-1a7545da-8f99-4354-bd94-477abdf785a3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac" status: 200 len: 1366 microversion: 2.1 time: 0.294973 Aug 12 01:33:30.495596 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 389/779] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:30 2022] GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac => generated 1366 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:30.594044 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-5df9d71c-036b-4dae-b0d3-877706115f15 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:30.595784 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-5df9d71c-036b-4dae-b0d3-877706115f15 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:30.605819 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5df9d71c-036b-4dae-b0d3-877706115f15 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:30.606313 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5df9d71c-036b-4dae-b0d3-877706115f15 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:30.607019 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5df9d71c-036b-4dae-b0d3-877706115f15 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:30.607757 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5df9d71c-036b-4dae-b0d3-877706115f15 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:30.608213 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5df9d71c-036b-4dae-b0d3-877706115f15 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:30.608635 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5df9d71c-036b-4dae-b0d3-877706115f15 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:30.820312 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-5df9d71c-036b-4dae-b0d3-877706115f15 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:30.842957 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-5df9d71c-036b-4dae-b0d3-877706115f15 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:30.845087 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-5df9d71c-036b-4dae-b0d3-877706115f15 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:30.846694 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-5df9d71c-036b-4dae-b0d3-877706115f15 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1740 microversion: 2.20 time: 0.257423 Aug 12 01:33:30.848341 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 391/780] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:33:30 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1740 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:33:31.470748 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-31cd64c4-e53d-4447-b340-344fedb603cf req-1f733de4-426e-4718-8df0-39da1852e03a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3d50f7a-89e5-4250-be37-7fdf4f9b79da", "name": "network-vif-plugged", "status": "completed", "tag": "a7da4e13-3cc9-4eeb-9f82-064424d0880e"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:33:31.494508 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-31cd64c4-e53d-4447-b340-344fedb603cf req-1f733de4-426e-4718-8df0-39da1852e03a service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:31.495298 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-31cd64c4-e53d-4447-b340-344fedb603cf req-1f733de4-426e-4718-8df0-39da1852e03a service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:31.504451 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-ed24448d-bf9a-4bbe-bbe6-f61461c4ec52 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:31.505356 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-ed24448d-bf9a-4bbe-bbe6-f61461c4ec52 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 2bb87cca-3f2d-4017-9cb9-1f309cdaacac] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:31.511918 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-31cd64c4-e53d-4447-b340-344fedb603cf req-1f733de4-426e-4718-8df0-39da1852e03a service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:31.519786 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ed24448d-bf9a-4bbe-bbe6-f61461c4ec52 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:31.520560 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ed24448d-bf9a-4bbe-bbe6-f61461c4ec52 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:31.521167 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ed24448d-bf9a-4bbe-bbe6-f61461c4ec52 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:31.522054 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ed24448d-bf9a-4bbe-bbe6-f61461c4ec52 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:31.524127 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ed24448d-bf9a-4bbe-bbe6-f61461c4ec52 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:31.527386 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ed24448d-bf9a-4bbe-bbe6-f61461c4ec52 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:31.550648 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-31cd64c4-e53d-4447-b340-344fedb603cf req-1f733de4-426e-4718-8df0-39da1852e03a service nova] Creating event network-vif-plugged:a7da4e13-3cc9-4eeb-9f82-064424d0880e for instance f3d50f7a-89e5-4250-be37-7fdf4f9b79da on hv-cinder-78481 Aug 12 01:33:31.557892 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-31cd64c4-e53d-4447-b340-344fedb603cf req-1f733de4-426e-4718-8df0-39da1852e03a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090596 Aug 12 01:33:31.561291 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 390/781] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:33:31.779920 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-ed24448d-bf9a-4bbe-bbe6-f61461c4ec52 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:31.787718 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-ed24448d-bf9a-4bbe-bbe6-f61461c4ec52 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac" status: 200 len: 1557 microversion: 2.1 time: 0.288667 Aug 12 01:33:31.803882 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 392/782] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:33:31 2022] GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac => generated 1557 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:33:31.813256 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-be1b69e6-e554-417f-be50-3d75bd55d0a7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:31.814263 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-be1b69e6-e554-417f-be50-3d75bd55d0a7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 2bb87cca-3f2d-4017-9cb9-1f309cdaacac] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:31.824682 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-be1b69e6-e554-417f-be50-3d75bd55d0a7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:31.825491 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-be1b69e6-e554-417f-be50-3d75bd55d0a7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:31.826138 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-be1b69e6-e554-417f-be50-3d75bd55d0a7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:31.827423 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-be1b69e6-e554-417f-be50-3d75bd55d0a7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:31.828048 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-be1b69e6-e554-417f-be50-3d75bd55d0a7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:31.828649 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-be1b69e6-e554-417f-be50-3d75bd55d0a7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:31.858571 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell1:SELECT=100 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:33:31.870708 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-f4314172-655e-4f28-8ccd-4ac0b7d0e517 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:31.871227 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-f4314172-655e-4f28-8ccd-4ac0b7d0e517 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:31.874618 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:33:31.878045 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f4314172-655e-4f28-8ccd-4ac0b7d0e517 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:31.880218 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f4314172-655e-4f28-8ccd-4ac0b7d0e517 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:31.880911 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f4314172-655e-4f28-8ccd-4ac0b7d0e517 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:31.881734 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f4314172-655e-4f28-8ccd-4ac0b7d0e517 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:31.882465 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f4314172-655e-4f28-8ccd-4ac0b7d0e517 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:31.883232 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f4314172-655e-4f28-8ccd-4ac0b7d0e517 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:31.950821 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-be1b69e6-e554-417f-be50-3d75bd55d0a7 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.145544 Aug 12 01:33:31.956372 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 391/783] 10.222.0.20 () {58 vars in 1275 bytes} [Fri Aug 12 01:33:31 2022] GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac/os-interface => generated 285 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 01:33:32.120396 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-f4314172-655e-4f28-8ccd-4ac0b7d0e517 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:32.129427 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-f4314172-655e-4f28-8ccd-4ac0b7d0e517 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:32.141488 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-f4314172-655e-4f28-8ccd-4ac0b7d0e517 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:32.142935 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-f4314172-655e-4f28-8ccd-4ac0b7d0e517 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1740 microversion: 2.20 time: 0.276524 Aug 12 01:33:32.144124 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 393/784] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:33:31 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1740 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 01:33:32.793242 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-6c548da5-1141-4c6a-b370-3b4e0652db75 req-534569fe-2d5d-497b-affd-78b2f9e65498 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e61e785b-aa63-4b29-b82d-185988c73bc1", "tag": "7f3a189a-2823-4a1c-8884-bc1b49992c1c"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:33:32.819953 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-6c548da5-1141-4c6a-b370-3b4e0652db75 req-534569fe-2d5d-497b-affd-78b2f9e65498 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:32.821923 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-6c548da5-1141-4c6a-b370-3b4e0652db75 req-534569fe-2d5d-497b-affd-78b2f9e65498 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:32.822818 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-6c548da5-1141-4c6a-b370-3b4e0652db75 req-534569fe-2d5d-497b-affd-78b2f9e65498 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:32.847770 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-6c548da5-1141-4c6a-b370-3b4e0652db75 req-534569fe-2d5d-497b-affd-78b2f9e65498 service nova] Creating event network-changed:7f3a189a-2823-4a1c-8884-bc1b49992c1c for instance e61e785b-aa63-4b29-b82d-185988c73bc1 on hv-cinder-78481 Aug 12 01:33:32.859770 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-6c548da5-1141-4c6a-b370-3b4e0652db75 req-534569fe-2d5d-497b-affd-78b2f9e65498 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069905 Aug 12 01:33:32.863846 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 392/785] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:33:33.171125 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-b6423dec-2f2b-4b7a-9690-8ca8622c492f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:33.173150 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-b6423dec-2f2b-4b7a-9690-8ca8622c492f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:33.185285 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b6423dec-2f2b-4b7a-9690-8ca8622c492f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:33.186087 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b6423dec-2f2b-4b7a-9690-8ca8622c492f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:33.187338 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b6423dec-2f2b-4b7a-9690-8ca8622c492f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:33.188395 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b6423dec-2f2b-4b7a-9690-8ca8622c492f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:33.189616 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b6423dec-2f2b-4b7a-9690-8ca8622c492f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:33.190753 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b6423dec-2f2b-4b7a-9690-8ca8622c492f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:33.492032 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-b6423dec-2f2b-4b7a-9690-8ca8622c492f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:33.503962 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-b6423dec-2f2b-4b7a-9690-8ca8622c492f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:33.507946 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-b6423dec-2f2b-4b7a-9690-8ca8622c492f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:33.512569 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-b6423dec-2f2b-4b7a-9690-8ca8622c492f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1740 microversion: 2.20 time: 0.350905 Aug 12 01:33:33.513265 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 394/786] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:33:33 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1740 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:33:34.059240 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-9df2e9e8-dcb5-403f-975c-73522c95bbe5 req-4c80516c-5a82-4409-b6b2-d4e2ccc6d495 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bb87cca-3f2d-4017-9cb9-1f309cdaacac", "tag": "e6870c02-031d-4413-920d-dcc367128484"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:33:34.081703 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-9df2e9e8-dcb5-403f-975c-73522c95bbe5 req-4c80516c-5a82-4409-b6b2-d4e2ccc6d495 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:34.082187 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-9df2e9e8-dcb5-403f-975c-73522c95bbe5 req-4c80516c-5a82-4409-b6b2-d4e2ccc6d495 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:34.082621 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-9df2e9e8-dcb5-403f-975c-73522c95bbe5 req-4c80516c-5a82-4409-b6b2-d4e2ccc6d495 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:34.123101 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-9df2e9e8-dcb5-403f-975c-73522c95bbe5 req-4c80516c-5a82-4409-b6b2-d4e2ccc6d495 service nova] Creating event network-changed:e6870c02-031d-4413-920d-dcc367128484 for instance 2bb87cca-3f2d-4017-9cb9-1f309cdaacac on hv-cinder-78481 Aug 12 01:33:34.136952 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-9df2e9e8-dcb5-403f-975c-73522c95bbe5 req-4c80516c-5a82-4409-b6b2-d4e2ccc6d495 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.309834 Aug 12 01:33:34.140087 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 393/787] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:33:34.535349 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-8c9f21c5-673c-4739-8d8d-d9dde9b6feda tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:34.537116 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-8c9f21c5-673c-4739-8d8d-d9dde9b6feda tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:34.546576 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8c9f21c5-673c-4739-8d8d-d9dde9b6feda tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:34.550516 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8c9f21c5-673c-4739-8d8d-d9dde9b6feda tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:34.552300 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8c9f21c5-673c-4739-8d8d-d9dde9b6feda tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:34.553710 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8c9f21c5-673c-4739-8d8d-d9dde9b6feda tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:34.554975 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8c9f21c5-673c-4739-8d8d-d9dde9b6feda tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:34.558089 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8c9f21c5-673c-4739-8d8d-d9dde9b6feda tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:34.875203 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-8c9f21c5-673c-4739-8d8d-d9dde9b6feda tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:34.897369 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-8c9f21c5-673c-4739-8d8d-d9dde9b6feda tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:34.899752 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-8c9f21c5-673c-4739-8d8d-d9dde9b6feda tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:34.902232 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-8c9f21c5-673c-4739-8d8d-d9dde9b6feda tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1740 microversion: 2.20 time: 0.370809 Aug 12 01:33:34.916648 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 395/788] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:33:34 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1740 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:33:35.930349 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-c23df94b-4b24-4730-8322-d4170d3b49a9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:35.931042 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-c23df94b-4b24-4730-8322-d4170d3b49a9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:35.944532 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c23df94b-4b24-4730-8322-d4170d3b49a9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:35.945009 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c23df94b-4b24-4730-8322-d4170d3b49a9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:35.948538 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c23df94b-4b24-4730-8322-d4170d3b49a9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:35.949251 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c23df94b-4b24-4730-8322-d4170d3b49a9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:35.949699 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c23df94b-4b24-4730-8322-d4170d3b49a9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:35.950118 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c23df94b-4b24-4730-8322-d4170d3b49a9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:36.092676 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-c23df94b-4b24-4730-8322-d4170d3b49a9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:36.102320 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-c23df94b-4b24-4730-8322-d4170d3b49a9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:36.104172 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-c23df94b-4b24-4730-8322-d4170d3b49a9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:36.105491 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-c23df94b-4b24-4730-8322-d4170d3b49a9 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1740 microversion: 2.20 time: 0.182968 Aug 12 01:33:36.106362 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 394/789] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:33:35 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:33:37.132062 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-7b31bd84-075e-449b-91aa-f49dec97a09f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:37.132664 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-7b31bd84-075e-449b-91aa-f49dec97a09f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:37.143547 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7b31bd84-075e-449b-91aa-f49dec97a09f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:37.144177 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7b31bd84-075e-449b-91aa-f49dec97a09f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:37.144474 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7b31bd84-075e-449b-91aa-f49dec97a09f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:37.145209 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7b31bd84-075e-449b-91aa-f49dec97a09f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:37.145683 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7b31bd84-075e-449b-91aa-f49dec97a09f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:37.146104 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7b31bd84-075e-449b-91aa-f49dec97a09f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:37.313720 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-7b31bd84-075e-449b-91aa-f49dec97a09f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:37.326610 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-7b31bd84-075e-449b-91aa-f49dec97a09f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:37.328446 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-7b31bd84-075e-449b-91aa-f49dec97a09f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:37.329746 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-7b31bd84-075e-449b-91aa-f49dec97a09f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1740 microversion: 2.20 time: 0.202665 Aug 12 01:33:37.330895 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 396/790] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:33:37 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1740 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:33:38.358848 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-7ff86b2f-c200-4b4d-95f9-b8fa9d838207 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:38.359647 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-7ff86b2f-c200-4b4d-95f9-b8fa9d838207 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:38.370717 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7ff86b2f-c200-4b4d-95f9-b8fa9d838207 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:38.371235 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7ff86b2f-c200-4b4d-95f9-b8fa9d838207 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:38.371696 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7ff86b2f-c200-4b4d-95f9-b8fa9d838207 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:38.372439 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7ff86b2f-c200-4b4d-95f9-b8fa9d838207 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:38.378533 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7ff86b2f-c200-4b4d-95f9-b8fa9d838207 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:38.379101 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7ff86b2f-c200-4b4d-95f9-b8fa9d838207 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:38.553577 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-7ff86b2f-c200-4b4d-95f9-b8fa9d838207 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:38.566482 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-7ff86b2f-c200-4b4d-95f9-b8fa9d838207 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:38.568410 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-7ff86b2f-c200-4b4d-95f9-b8fa9d838207 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:38.569799 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-7ff86b2f-c200-4b4d-95f9-b8fa9d838207 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1740 microversion: 2.20 time: 0.221177 Aug 12 01:33:38.570984 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 395/791] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:33:38 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1740 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:33:39.595698 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-9f6821dd-dacf-42ce-91bc-f2a7fbc6a1a1 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:39.595698 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-9f6821dd-dacf-42ce-91bc-f2a7fbc6a1a1 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:39.601707 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9f6821dd-dacf-42ce-91bc-f2a7fbc6a1a1 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:39.602200 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9f6821dd-dacf-42ce-91bc-f2a7fbc6a1a1 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:39.602887 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9f6821dd-dacf-42ce-91bc-f2a7fbc6a1a1 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:39.606092 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9f6821dd-dacf-42ce-91bc-f2a7fbc6a1a1 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:39.607657 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9f6821dd-dacf-42ce-91bc-f2a7fbc6a1a1 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:39.608367 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9f6821dd-dacf-42ce-91bc-f2a7fbc6a1a1 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:39.789849 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-9f6821dd-dacf-42ce-91bc-f2a7fbc6a1a1 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:39.803694 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-9f6821dd-dacf-42ce-91bc-f2a7fbc6a1a1 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:39.805864 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-9f6821dd-dacf-42ce-91bc-f2a7fbc6a1a1 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:39.807379 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-9f6821dd-dacf-42ce-91bc-f2a7fbc6a1a1 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1740 microversion: 2.20 time: 0.217973 Aug 12 01:33:39.808156 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 397/792] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:33:39 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1740 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:33:40.837171 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-95197f70-78f0-418d-8677-b57261854bdb tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:40.837777 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-95197f70-78f0-418d-8677-b57261854bdb tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:40.844691 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-95197f70-78f0-418d-8677-b57261854bdb tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:40.845169 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-95197f70-78f0-418d-8677-b57261854bdb tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:40.845595 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-95197f70-78f0-418d-8677-b57261854bdb tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:40.846289 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-95197f70-78f0-418d-8677-b57261854bdb tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:40.846941 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-95197f70-78f0-418d-8677-b57261854bdb tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:40.847562 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-95197f70-78f0-418d-8677-b57261854bdb tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:40.983987 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-95197f70-78f0-418d-8677-b57261854bdb tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:40.992267 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-95197f70-78f0-418d-8677-b57261854bdb tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:40.993756 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-95197f70-78f0-418d-8677-b57261854bdb tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:40.994966 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-95197f70-78f0-418d-8677-b57261854bdb tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1740 microversion: 2.20 time: 0.161660 Aug 12 01:33:40.995556 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 396/793] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:33:40 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:33:41.311489 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-d420ce13-4a05-4c50-8d1c-1b2839a0e660 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:41.312280 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-d420ce13-4a05-4c50-8d1c-1b2839a0e660 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: 30c8fb82-5cf9-4388-8481-285e8a09c261] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:41.319597 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d420ce13-4a05-4c50-8d1c-1b2839a0e660 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:41.319975 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d420ce13-4a05-4c50-8d1c-1b2839a0e660 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:41.320409 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d420ce13-4a05-4c50-8d1c-1b2839a0e660 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:41.321113 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d420ce13-4a05-4c50-8d1c-1b2839a0e660 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:41.321562 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d420ce13-4a05-4c50-8d1c-1b2839a0e660 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:41.321984 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d420ce13-4a05-4c50-8d1c-1b2839a0e660 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:41.349117 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-d420ce13-4a05-4c50-8d1c-1b2839a0e660 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261/ips" status: 200 len: 144 microversion: 2.1 time: 0.281939 Aug 12 01:33:41.349683 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 398/794] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Aug 12 01:33:41 2022] GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261/ips => generated 144 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:33:42.017585 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-4200863e-a066-4bb3-b780-16efcadf540a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:42.018196 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-4200863e-a066-4bb3-b780-16efcadf540a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:42.025504 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4200863e-a066-4bb3-b780-16efcadf540a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:42.026222 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4200863e-a066-4bb3-b780-16efcadf540a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:42.026848 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4200863e-a066-4bb3-b780-16efcadf540a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:42.028510 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4200863e-a066-4bb3-b780-16efcadf540a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:42.029288 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4200863e-a066-4bb3-b780-16efcadf540a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:42.029683 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4200863e-a066-4bb3-b780-16efcadf540a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:42.203697 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-4200863e-a066-4bb3-b780-16efcadf540a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:42.211960 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-4200863e-a066-4bb3-b780-16efcadf540a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:42.213451 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-4200863e-a066-4bb3-b780-16efcadf540a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:42.214803 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-4200863e-a066-4bb3-b780-16efcadf540a tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1722 microversion: 2.20 time: 0.201400 Aug 12 01:33:42.215457 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 397/795] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:33:42 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:33:42.748605 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-c3f6d89f-16c3-45f6-9222-3c6cf58c9ae6 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "147cb519-62a1-4422-a117-84502da68d6b"}} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:33:42.751003 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-c3f6d89f-16c3-45f6-9222-3c6cf58c9ae6 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: 30c8fb82-5cf9-4388-8481-285e8a09c261] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:42.757656 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c3f6d89f-16c3-45f6-9222-3c6cf58c9ae6 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:42.758134 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c3f6d89f-16c3-45f6-9222-3c6cf58c9ae6 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:42.758557 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c3f6d89f-16c3-45f6-9222-3c6cf58c9ae6 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:42.759232 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c3f6d89f-16c3-45f6-9222-3c6cf58c9ae6 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:42.759708 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c3f6d89f-16c3-45f6-9222-3c6cf58c9ae6 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:42.760115 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c3f6d89f-16c3-45f6-9222-3c6cf58c9ae6 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:43.242418 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-6bfa6a29-d07c-42a6-b008-ead16cad8beb tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:43.243403 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-6bfa6a29-d07c-42a6-b008-ead16cad8beb tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:43.251930 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6bfa6a29-d07c-42a6-b008-ead16cad8beb tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:43.252409 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6bfa6a29-d07c-42a6-b008-ead16cad8beb tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:43.252840 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6bfa6a29-d07c-42a6-b008-ead16cad8beb tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:43.253532 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6bfa6a29-d07c-42a6-b008-ead16cad8beb tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:43.253981 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6bfa6a29-d07c-42a6-b008-ead16cad8beb tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:43.254402 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6bfa6a29-d07c-42a6-b008-ead16cad8beb tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:43.391035 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-6bfa6a29-d07c-42a6-b008-ead16cad8beb tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:43.399987 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-6bfa6a29-d07c-42a6-b008-ead16cad8beb tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:43.401657 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-6bfa6a29-d07c-42a6-b008-ead16cad8beb tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:43.402919 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-6bfa6a29-d07c-42a6-b008-ead16cad8beb tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1722 microversion: 2.20 time: 0.167167 Aug 12 01:33:43.403704 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 398/796] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:33:43 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:33:43.826591 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-c3f6d89f-16c3-45f6-9222-3c6cf58c9ae6 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "POST /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.081785 Aug 12 01:33:43.827188 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 399/797] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Aug 12 01:33:42 2022] POST /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261/os-volume_attachments => generated 194 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:33:44.425585 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-46c15eac-3e60-41df-b98e-161894839237 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:44.426136 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-46c15eac-3e60-41df-b98e-161894839237 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:44.433374 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-46c15eac-3e60-41df-b98e-161894839237 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:44.433846 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-46c15eac-3e60-41df-b98e-161894839237 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:44.434269 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-46c15eac-3e60-41df-b98e-161894839237 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:44.435177 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-46c15eac-3e60-41df-b98e-161894839237 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:44.435665 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-46c15eac-3e60-41df-b98e-161894839237 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:44.436086 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-46c15eac-3e60-41df-b98e-161894839237 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:44.569289 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-46c15eac-3e60-41df-b98e-161894839237 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:44.577419 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-46c15eac-3e60-41df-b98e-161894839237 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:44.578934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-46c15eac-3e60-41df-b98e-161894839237 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:44.580120 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-46c15eac-3e60-41df-b98e-161894839237 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1665 microversion: 2.20 time: 0.158494 Aug 12 01:33:44.580658 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 399/798] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:33:44 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1665 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:33:44.602879 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-13ea6184-ca17-4f70-aea1-85682bb8c959 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "989befeb-9662-4e21-85c8-c561bd42434d"}} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:33:44.605344 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-13ea6184-ca17-4f70-aea1-85682bb8c959 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:44.611522 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-13ea6184-ca17-4f70-aea1-85682bb8c959 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:44.612040 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-13ea6184-ca17-4f70-aea1-85682bb8c959 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:44.612469 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-13ea6184-ca17-4f70-aea1-85682bb8c959 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:44.613152 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-13ea6184-ca17-4f70-aea1-85682bb8c959 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:44.613594 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-13ea6184-ca17-4f70-aea1-85682bb8c959 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:44.614008 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-13ea6184-ca17-4f70-aea1-85682bb8c959 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:44.925298 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-13ea6184-ca17-4f70-aea1-85682bb8c959 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "POST /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.327192 Aug 12 01:33:44.925952 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 400/799] 10.222.0.20 () {62 vars in 1364 bytes} [Fri Aug 12 01:33:44 2022] POST /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da/os-volume_attachments => generated 188 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 01:33:45.063184 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-a912629f-d908-4138-bce3-9b4bbbd58c31 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:45.064107 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-a912629f-d908-4138-bce3-9b4bbbd58c31 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:45.070144 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a912629f-d908-4138-bce3-9b4bbbd58c31 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:45.070963 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a912629f-d908-4138-bce3-9b4bbbd58c31 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:45.071603 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a912629f-d908-4138-bce3-9b4bbbd58c31 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:45.072492 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a912629f-d908-4138-bce3-9b4bbbd58c31 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:45.073198 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a912629f-d908-4138-bce3-9b4bbbd58c31 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:45.073798 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a912629f-d908-4138-bce3-9b4bbbd58c31 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:45.262219 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-31aec440-65bb-4abc-90c6-eb5ecd4bcbc4 req-29dfec71-8103-4b8c-8f6c-25038de706ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3d50f7a-89e5-4250-be37-7fdf4f9b79da", "name": "network-vif-unplugged", "status": "completed", "tag": "a7da4e13-3cc9-4eeb-9f82-064424d0880e"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:33:45.273634 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-31aec440-65bb-4abc-90c6-eb5ecd4bcbc4 req-29dfec71-8103-4b8c-8f6c-25038de706ea service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:45.274106 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-31aec440-65bb-4abc-90c6-eb5ecd4bcbc4 req-29dfec71-8103-4b8c-8f6c-25038de706ea service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:45.274691 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-31aec440-65bb-4abc-90c6-eb5ecd4bcbc4 req-29dfec71-8103-4b8c-8f6c-25038de706ea service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:45.285265 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.compute.server_external_events [req-31aec440-65bb-4abc-90c6-eb5ecd4bcbc4 req-29dfec71-8103-4b8c-8f6c-25038de706ea service nova] Unable to find a host for instance f3d50f7a-89e5-4250-be37-7fdf4f9b79da. Dropping event network-vif-unplugged {{(pid=120786) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 12 01:33:45.286142 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-31aec440-65bb-4abc-90c6-eb5ecd4bcbc4 req-29dfec71-8103-4b8c-8f6c-25038de706ea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.175000 Aug 12 01:33:45.286725 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 401/800] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 176 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 12 01:33:45.349937 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-a912629f-d908-4138-bce3-9b4bbbd58c31 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da/os-volume_attachments/989befeb-9662-4e21-85c8-c561bd42434d" status: 202 len: 0 microversion: 2.20 time: 0.290668 Aug 12 01:33:45.350666 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 400/801] 10.222.0.20 () {60 vars in 1457 bytes} [Fri Aug 12 01:33:45 2022] DELETE /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da/os-volume_attachments/989befeb-9662-4e21-85c8-c561bd42434d => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 12 01:33:45.411023 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-ab4c1f3a-921d-4018-9fb4-a8ac9ae354ac tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:33:45.411643 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-ab4c1f3a-921d-4018-9fb4-a8ac9ae354ac tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:45.417610 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ab4c1f3a-921d-4018-9fb4-a8ac9ae354ac tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:45.418164 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ab4c1f3a-921d-4018-9fb4-a8ac9ae354ac tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:45.418648 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ab4c1f3a-921d-4018-9fb4-a8ac9ae354ac tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:45.419351 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ab4c1f3a-921d-4018-9fb4-a8ac9ae354ac tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:45.419808 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ab4c1f3a-921d-4018-9fb4-a8ac9ae354ac tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:45.420216 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ab4c1f3a-921d-4018-9fb4-a8ac9ae354ac tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:45.450643 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-ab4c1f3a-921d-4018-9fb4-a8ac9ae354ac tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120786) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 12 01:33:45.521262 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-ab4c1f3a-921d-4018-9fb4-a8ac9ae354ac tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "POST /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da/action" status: 202 len: 0 microversion: 2.20 time: 0.114407 Aug 12 01:33:45.522306 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 402/802] 10.222.0.20 () {62 vars in 1319 bytes} [Fri Aug 12 01:33:45 2022] POST /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 12 01:33:45.531006 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-ab47c117-54cd-4e96-97ec-bbbd5a127850 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:45.532154 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-ab47c117-54cd-4e96-97ec-bbbd5a127850 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:45.539089 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ab47c117-54cd-4e96-97ec-bbbd5a127850 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:45.540091 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ab47c117-54cd-4e96-97ec-bbbd5a127850 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:45.540597 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ab47c117-54cd-4e96-97ec-bbbd5a127850 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:45.541376 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ab47c117-54cd-4e96-97ec-bbbd5a127850 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:45.541836 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ab47c117-54cd-4e96-97ec-bbbd5a127850 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:45.542639 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ab47c117-54cd-4e96-97ec-bbbd5a127850 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:45.689399 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-ab47c117-54cd-4e96-97ec-bbbd5a127850 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:45.697869 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-ab47c117-54cd-4e96-97ec-bbbd5a127850 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:45.699359 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-ab47c117-54cd-4e96-97ec-bbbd5a127850 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:45.700706 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-ab47c117-54cd-4e96-97ec-bbbd5a127850 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1673 microversion: 2.20 time: 0.174370 Aug 12 01:33:45.701267 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 401/803] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:33:45 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1673 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:33:46.723671 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-fd37aa02-7923-4f4a-8c3d-b92c50c70409 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:46.724262 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-fd37aa02-7923-4f4a-8c3d-b92c50c70409 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:46.730606 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fd37aa02-7923-4f4a-8c3d-b92c50c70409 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:46.731085 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fd37aa02-7923-4f4a-8c3d-b92c50c70409 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:46.731517 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fd37aa02-7923-4f4a-8c3d-b92c50c70409 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:46.732297 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fd37aa02-7923-4f4a-8c3d-b92c50c70409 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:46.732740 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fd37aa02-7923-4f4a-8c3d-b92c50c70409 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:46.733155 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fd37aa02-7923-4f4a-8c3d-b92c50c70409 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:46.754446 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:33:46.873617 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-fd37aa02-7923-4f4a-8c3d-b92c50c70409 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:46.881599 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-fd37aa02-7923-4f4a-8c3d-b92c50c70409 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:46.883147 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-fd37aa02-7923-4f4a-8c3d-b92c50c70409 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:46.884336 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-fd37aa02-7923-4f4a-8c3d-b92c50c70409 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1731 microversion: 2.20 time: 0.165111 Aug 12 01:33:46.884948 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 403/804] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:33:46 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:33:47.908803 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-66c46032-63c3-4954-9baa-67dbecd70221 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:47.909599 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-66c46032-63c3-4954-9baa-67dbecd70221 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:47.927052 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-66c46032-63c3-4954-9baa-67dbecd70221 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:47.929056 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-66c46032-63c3-4954-9baa-67dbecd70221 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:47.929510 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-66c46032-63c3-4954-9baa-67dbecd70221 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:47.930238 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-66c46032-63c3-4954-9baa-67dbecd70221 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:47.930687 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-66c46032-63c3-4954-9baa-67dbecd70221 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:47.934570 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-66c46032-63c3-4954-9baa-67dbecd70221 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:48.084146 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-66c46032-63c3-4954-9baa-67dbecd70221 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:48.093440 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-66c46032-63c3-4954-9baa-67dbecd70221 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:48.095713 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-66c46032-63c3-4954-9baa-67dbecd70221 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:48.097251 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-66c46032-63c3-4954-9baa-67dbecd70221 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1731 microversion: 2.20 time: 0.192563 Aug 12 01:33:48.113727 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 402/805] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:33:47 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1731 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:33:49.121125 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-1d7de5ad-86bf-4712-84ee-c528063b3a71 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:49.121751 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-1d7de5ad-86bf-4712-84ee-c528063b3a71 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:49.128550 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1d7de5ad-86bf-4712-84ee-c528063b3a71 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:49.129028 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1d7de5ad-86bf-4712-84ee-c528063b3a71 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:49.129453 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1d7de5ad-86bf-4712-84ee-c528063b3a71 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:49.130135 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1d7de5ad-86bf-4712-84ee-c528063b3a71 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:49.130632 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1d7de5ad-86bf-4712-84ee-c528063b3a71 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:49.130986 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-1d7de5ad-86bf-4712-84ee-c528063b3a71 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:49.296931 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-1d7de5ad-86bf-4712-84ee-c528063b3a71 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:49.306937 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-1d7de5ad-86bf-4712-84ee-c528063b3a71 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:49.308926 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-1d7de5ad-86bf-4712-84ee-c528063b3a71 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:49.310630 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-1d7de5ad-86bf-4712-84ee-c528063b3a71 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1731 microversion: 2.20 time: 0.193291 Aug 12 01:33:49.311811 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 404/806] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:33:49 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1731 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:33:50.335383 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-47035693-50f3-4829-b7fd-02d1efedfb6c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:50.336158 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-47035693-50f3-4829-b7fd-02d1efedfb6c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:50.344468 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-47035693-50f3-4829-b7fd-02d1efedfb6c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:50.345750 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-47035693-50f3-4829-b7fd-02d1efedfb6c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:50.347035 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-47035693-50f3-4829-b7fd-02d1efedfb6c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:50.348699 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-47035693-50f3-4829-b7fd-02d1efedfb6c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:50.349249 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-47035693-50f3-4829-b7fd-02d1efedfb6c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:50.349735 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-47035693-50f3-4829-b7fd-02d1efedfb6c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:50.505603 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-47035693-50f3-4829-b7fd-02d1efedfb6c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:50.514039 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-47035693-50f3-4829-b7fd-02d1efedfb6c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:50.515774 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-47035693-50f3-4829-b7fd-02d1efedfb6c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:50.517128 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-47035693-50f3-4829-b7fd-02d1efedfb6c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1731 microversion: 2.20 time: 0.186681 Aug 12 01:33:50.532134 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 403/807] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:33:50 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1731 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:33:51.541203 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-4d0a9f6c-6ca7-4408-ba0a-e8e5e7354ac2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:51.542556 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-4d0a9f6c-6ca7-4408-ba0a-e8e5e7354ac2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:51.550074 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4d0a9f6c-6ca7-4408-ba0a-e8e5e7354ac2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:51.550885 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4d0a9f6c-6ca7-4408-ba0a-e8e5e7354ac2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:51.551511 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4d0a9f6c-6ca7-4408-ba0a-e8e5e7354ac2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:51.552714 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4d0a9f6c-6ca7-4408-ba0a-e8e5e7354ac2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:51.553380 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4d0a9f6c-6ca7-4408-ba0a-e8e5e7354ac2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:51.553882 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4d0a9f6c-6ca7-4408-ba0a-e8e5e7354ac2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:51.689593 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-4d0a9f6c-6ca7-4408-ba0a-e8e5e7354ac2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:51.698566 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-4d0a9f6c-6ca7-4408-ba0a-e8e5e7354ac2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:51.700071 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-4d0a9f6c-6ca7-4408-ba0a-e8e5e7354ac2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:51.701304 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-4d0a9f6c-6ca7-4408-ba0a-e8e5e7354ac2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1731 microversion: 2.20 time: 0.164340 Aug 12 01:33:51.701862 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 405/808] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:33:51 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:33:52.724555 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-c7abacb4-7589-4147-bec1-c377ddfeb825 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:52.725298 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-c7abacb4-7589-4147-bec1-c377ddfeb825 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:52.731981 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c7abacb4-7589-4147-bec1-c377ddfeb825 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:52.732479 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c7abacb4-7589-4147-bec1-c377ddfeb825 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:52.732908 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c7abacb4-7589-4147-bec1-c377ddfeb825 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:52.733602 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c7abacb4-7589-4147-bec1-c377ddfeb825 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:52.734044 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c7abacb4-7589-4147-bec1-c377ddfeb825 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:52.734493 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-c7abacb4-7589-4147-bec1-c377ddfeb825 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:52.874790 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-c7abacb4-7589-4147-bec1-c377ddfeb825 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:52.883071 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-c7abacb4-7589-4147-bec1-c377ddfeb825 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:52.884591 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-c7abacb4-7589-4147-bec1-c377ddfeb825 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:52.885953 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-c7abacb4-7589-4147-bec1-c377ddfeb825 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1731 microversion: 2.20 time: 0.165462 Aug 12 01:33:52.886665 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 404/809] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:33:52 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:33:53.910342 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-bbda2835-37ab-41a1-ad01-20ce0e2ed141 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:53.911070 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-bbda2835-37ab-41a1-ad01-20ce0e2ed141 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:53.917988 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-bbda2835-37ab-41a1-ad01-20ce0e2ed141 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:53.918469 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-bbda2835-37ab-41a1-ad01-20ce0e2ed141 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:53.918878 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-bbda2835-37ab-41a1-ad01-20ce0e2ed141 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:53.919654 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-bbda2835-37ab-41a1-ad01-20ce0e2ed141 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:53.920092 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-bbda2835-37ab-41a1-ad01-20ce0e2ed141 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:53.920507 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-bbda2835-37ab-41a1-ad01-20ce0e2ed141 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:54.080563 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-bbda2835-37ab-41a1-ad01-20ce0e2ed141 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:54.092750 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-bbda2835-37ab-41a1-ad01-20ce0e2ed141 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:54.094621 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-bbda2835-37ab-41a1-ad01-20ce0e2ed141 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:54.095819 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-bbda2835-37ab-41a1-ad01-20ce0e2ed141 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1731 microversion: 2.20 time: 0.189647 Aug 12 01:33:54.096409 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 406/810] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:33:53 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1731 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:33:55.122399 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-685fc17f-6ce8-40b8-986b-7ba03b410465 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:55.123038 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-685fc17f-6ce8-40b8-986b-7ba03b410465 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:55.130878 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-685fc17f-6ce8-40b8-986b-7ba03b410465 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:55.131358 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-685fc17f-6ce8-40b8-986b-7ba03b410465 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:55.131804 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-685fc17f-6ce8-40b8-986b-7ba03b410465 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:55.132498 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-685fc17f-6ce8-40b8-986b-7ba03b410465 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:55.132939 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-685fc17f-6ce8-40b8-986b-7ba03b410465 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:55.133347 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-685fc17f-6ce8-40b8-986b-7ba03b410465 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:55.282109 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-685fc17f-6ce8-40b8-986b-7ba03b410465 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:55.295294 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-685fc17f-6ce8-40b8-986b-7ba03b410465 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:55.297040 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-685fc17f-6ce8-40b8-986b-7ba03b410465 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:55.298328 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-685fc17f-6ce8-40b8-986b-7ba03b410465 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1731 microversion: 2.20 time: 0.180227 Aug 12 01:33:55.298890 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 405/811] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:33:55 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:33:56.322713 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-cdbdce26-df4b-4579-8f1e-501bfffe8929 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:56.323282 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-cdbdce26-df4b-4579-8f1e-501bfffe8929 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:56.330151 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cdbdce26-df4b-4579-8f1e-501bfffe8929 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:56.330620 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cdbdce26-df4b-4579-8f1e-501bfffe8929 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:56.331064 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cdbdce26-df4b-4579-8f1e-501bfffe8929 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:56.331757 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cdbdce26-df4b-4579-8f1e-501bfffe8929 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:56.332199 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cdbdce26-df4b-4579-8f1e-501bfffe8929 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:56.332614 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cdbdce26-df4b-4579-8f1e-501bfffe8929 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:56.479478 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-cdbdce26-df4b-4579-8f1e-501bfffe8929 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:56.490612 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-cdbdce26-df4b-4579-8f1e-501bfffe8929 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:56.492891 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-cdbdce26-df4b-4579-8f1e-501bfffe8929 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:56.494459 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-cdbdce26-df4b-4579-8f1e-501bfffe8929 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1731 microversion: 2.20 time: 0.175853 Aug 12 01:33:56.495236 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 407/812] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:33:56 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:33:57.520979 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-d062e01d-596a-4abf-af51-ee93e5885771 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:57.521850 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-d062e01d-596a-4abf-af51-ee93e5885771 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:57.525586 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_api:SELECT=47 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:33:57.532348 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d062e01d-596a-4abf-af51-ee93e5885771 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:57.532827 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d062e01d-596a-4abf-af51-ee93e5885771 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:57.533256 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d062e01d-596a-4abf-af51-ee93e5885771 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:57.533939 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d062e01d-596a-4abf-af51-ee93e5885771 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:57.534386 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d062e01d-596a-4abf-af51-ee93e5885771 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:57.534802 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d062e01d-596a-4abf-af51-ee93e5885771 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:57.673995 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-d062e01d-596a-4abf-af51-ee93e5885771 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:57.682504 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-d062e01d-596a-4abf-af51-ee93e5885771 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:57.684030 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-d062e01d-596a-4abf-af51-ee93e5885771 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:57.686093 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-d062e01d-596a-4abf-af51-ee93e5885771 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1731 microversion: 2.20 time: 0.171808 Aug 12 01:33:57.686667 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 406/813] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:33:57 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:33:58.708303 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-115a24c8-157c-41cd-9e6a-f0d9f93e121c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:58.708924 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-115a24c8-157c-41cd-9e6a-f0d9f93e121c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:58.715487 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-115a24c8-157c-41cd-9e6a-f0d9f93e121c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:58.716002 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-115a24c8-157c-41cd-9e6a-f0d9f93e121c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:58.716465 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-115a24c8-157c-41cd-9e6a-f0d9f93e121c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:58.717166 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-115a24c8-157c-41cd-9e6a-f0d9f93e121c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:58.717609 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-115a24c8-157c-41cd-9e6a-f0d9f93e121c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:58.718026 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-115a24c8-157c-41cd-9e6a-f0d9f93e121c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:58.881406 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-115a24c8-157c-41cd-9e6a-f0d9f93e121c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:58.889524 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-115a24c8-157c-41cd-9e6a-f0d9f93e121c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:58.891033 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-115a24c8-157c-41cd-9e6a-f0d9f93e121c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:33:58.892228 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-115a24c8-157c-41cd-9e6a-f0d9f93e121c tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1731 microversion: 2.20 time: 0.187790 Aug 12 01:33:58.893179 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 408/814] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:33:58 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1731 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:33:59.914887 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-2d05211b-c5e4-4c6c-94e6-37ea9aa50868 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:59.916890 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-2d05211b-c5e4-4c6c-94e6-37ea9aa50868 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:59.929267 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2d05211b-c5e4-4c6c-94e6-37ea9aa50868 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:59.929728 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2d05211b-c5e4-4c6c-94e6-37ea9aa50868 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:59.930402 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2d05211b-c5e4-4c6c-94e6-37ea9aa50868 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:59.931105 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2d05211b-c5e4-4c6c-94e6-37ea9aa50868 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:59.931635 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2d05211b-c5e4-4c6c-94e6-37ea9aa50868 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:59.932068 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-2d05211b-c5e4-4c6c-94e6-37ea9aa50868 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:59.948028 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:33:59.969481 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-0509d8f8-f98b-412f-89bf-5bd51756cfdd tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:33:59.971730 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-0509d8f8-f98b-412f-89bf-5bd51756cfdd tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: 30c8fb82-5cf9-4388-8481-285e8a09c261] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:33:59.979074 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0509d8f8-f98b-412f-89bf-5bd51756cfdd tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:59.979878 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0509d8f8-f98b-412f-89bf-5bd51756cfdd tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:59.980538 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0509d8f8-f98b-412f-89bf-5bd51756cfdd tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:33:59.981446 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0509d8f8-f98b-412f-89bf-5bd51756cfdd tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:33:59.982153 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0509d8f8-f98b-412f-89bf-5bd51756cfdd tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:33:59.982746 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0509d8f8-f98b-412f-89bf-5bd51756cfdd tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:00.012487 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-0509d8f8-f98b-412f-89bf-5bd51756cfdd tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047004 Aug 12 01:34:00.013209 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 409/815] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 01:33:59 2022] GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 01:34:00.024586 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-b1bfb895-3751-4956-8d56-3a9a5244425e tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:00.025172 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-b1bfb895-3751-4956-8d56-3a9a5244425e tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: 30c8fb82-5cf9-4388-8481-285e8a09c261] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:00.031312 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b1bfb895-3751-4956-8d56-3a9a5244425e tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:00.031910 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b1bfb895-3751-4956-8d56-3a9a5244425e tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:00.032408 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b1bfb895-3751-4956-8d56-3a9a5244425e tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:00.033196 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b1bfb895-3751-4956-8d56-3a9a5244425e tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:00.033708 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b1bfb895-3751-4956-8d56-3a9a5244425e tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:00.034191 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b1bfb895-3751-4956-8d56-3a9a5244425e tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:00.063476 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-b1bfb895-3751-4956-8d56-3a9a5244425e tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261/os-volume_attachments/147cb519-62a1-4422-a117-84502da68d6b" status: 200 len: 194 microversion: 2.1 time: 0.043453 Aug 12 01:34:00.064284 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 410/816] 10.222.0.20 () {58 vars in 1413 bytes} [Fri Aug 12 01:34:00 2022] GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261/os-volume_attachments/147cb519-62a1-4422-a117-84502da68d6b => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:34:00.072889 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-2d05211b-c5e4-4c6c-94e6-37ea9aa50868 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:00.081889 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-2d05211b-c5e4-4c6c-94e6-37ea9aa50868 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:00.083552 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-2d05211b-c5e4-4c6c-94e6-37ea9aa50868 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:00.084765 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-2d05211b-c5e4-4c6c-94e6-37ea9aa50868 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1731 microversion: 2.20 time: 0.174186 Aug 12 01:34:00.085334 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 407/817] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:33:59 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:34:01.108031 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-78abd4ad-3c6d-41b0-976a-7ca40583bcb3 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:01.108674 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-78abd4ad-3c6d-41b0-976a-7ca40583bcb3 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:01.116379 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-78abd4ad-3c6d-41b0-976a-7ca40583bcb3 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:01.117088 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-78abd4ad-3c6d-41b0-976a-7ca40583bcb3 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:01.117925 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-78abd4ad-3c6d-41b0-976a-7ca40583bcb3 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:01.118763 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-78abd4ad-3c6d-41b0-976a-7ca40583bcb3 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:01.119252 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-78abd4ad-3c6d-41b0-976a-7ca40583bcb3 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:01.119817 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-78abd4ad-3c6d-41b0-976a-7ca40583bcb3 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:01.255062 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-78abd4ad-3c6d-41b0-976a-7ca40583bcb3 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:01.263146 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-78abd4ad-3c6d-41b0-976a-7ca40583bcb3 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:01.264683 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-78abd4ad-3c6d-41b0-976a-7ca40583bcb3 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:01.265838 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-78abd4ad-3c6d-41b0-976a-7ca40583bcb3 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1731 microversion: 2.20 time: 0.162069 Aug 12 01:34:01.266405 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 411/818] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:34:01 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:34:01.419038 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-5002fba7-4f29-4317-89c0-d5be46415f07 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53cadd07-a46b-4e1e-97b1-f3c239fe6d20"}} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:34:01.421543 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-5002fba7-4f29-4317-89c0-d5be46415f07 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: 30c8fb82-5cf9-4388-8481-285e8a09c261] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:01.428453 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5002fba7-4f29-4317-89c0-d5be46415f07 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:01.428933 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5002fba7-4f29-4317-89c0-d5be46415f07 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:01.429355 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5002fba7-4f29-4317-89c0-d5be46415f07 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:01.430086 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5002fba7-4f29-4317-89c0-d5be46415f07 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:01.430528 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5002fba7-4f29-4317-89c0-d5be46415f07 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:01.430939 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5002fba7-4f29-4317-89c0-d5be46415f07 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:01.694277 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-5002fba7-4f29-4317-89c0-d5be46415f07 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "POST /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279208 Aug 12 01:34:01.700233 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 408/819] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Aug 12 01:34:01 2022] POST /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:34:02.290893 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-8330a144-7edf-4d64-8198-2319c476a64d tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:02.291517 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-8330a144-7edf-4d64-8198-2319c476a64d tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:02.294199 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:34:02.301163 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8330a144-7edf-4d64-8198-2319c476a64d tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:02.301677 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8330a144-7edf-4d64-8198-2319c476a64d tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:02.302431 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8330a144-7edf-4d64-8198-2319c476a64d tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:02.303171 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8330a144-7edf-4d64-8198-2319c476a64d tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:02.303650 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8330a144-7edf-4d64-8198-2319c476a64d tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:02.304071 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8330a144-7edf-4d64-8198-2319c476a64d tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:02.437520 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-8330a144-7edf-4d64-8198-2319c476a64d tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:02.446461 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-8330a144-7edf-4d64-8198-2319c476a64d tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:02.447992 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-8330a144-7edf-4d64-8198-2319c476a64d tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:02.449181 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-8330a144-7edf-4d64-8198-2319c476a64d tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1731 microversion: 2.20 time: 0.162507 Aug 12 01:34:02.449766 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 412/820] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:34:02 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:34:03.204771 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-8110674f-1174-4ef1-92fc-c5ac8bb53fab req-09391366-8aa6-4208-b455-0a5ff3263c4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3d50f7a-89e5-4250-be37-7fdf4f9b79da", "name": "network-vif-plugged", "status": "completed", "tag": "a7da4e13-3cc9-4eeb-9f82-064424d0880e"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:34:03.216855 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-8110674f-1174-4ef1-92fc-c5ac8bb53fab req-09391366-8aa6-4208-b455-0a5ff3263c4d service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:03.217409 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-8110674f-1174-4ef1-92fc-c5ac8bb53fab req-09391366-8aa6-4208-b455-0a5ff3263c4d service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:03.217867 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-8110674f-1174-4ef1-92fc-c5ac8bb53fab req-09391366-8aa6-4208-b455-0a5ff3263c4d service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:03.232243 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-8110674f-1174-4ef1-92fc-c5ac8bb53fab req-09391366-8aa6-4208-b455-0a5ff3263c4d service nova] Creating event network-vif-plugged:a7da4e13-3cc9-4eeb-9f82-064424d0880e for instance f3d50f7a-89e5-4250-be37-7fdf4f9b79da on hv-cinder-78481 Aug 12 01:34:03.237303 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-8110674f-1174-4ef1-92fc-c5ac8bb53fab req-09391366-8aa6-4208-b455-0a5ff3263c4d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037413 Aug 12 01:34:03.237886 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 409/821] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:34:03.474544 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-0be53e6b-74ae-4740-8cc4-8b0b23fb4c1f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:03.475146 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-0be53e6b-74ae-4740-8cc4-8b0b23fb4c1f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:03.482018 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0be53e6b-74ae-4740-8cc4-8b0b23fb4c1f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:03.482502 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0be53e6b-74ae-4740-8cc4-8b0b23fb4c1f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:03.482937 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0be53e6b-74ae-4740-8cc4-8b0b23fb4c1f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:03.483670 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0be53e6b-74ae-4740-8cc4-8b0b23fb4c1f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:03.484106 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0be53e6b-74ae-4740-8cc4-8b0b23fb4c1f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:03.484529 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0be53e6b-74ae-4740-8cc4-8b0b23fb4c1f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:03.628850 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-0be53e6b-74ae-4740-8cc4-8b0b23fb4c1f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:03.637100 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-0be53e6b-74ae-4740-8cc4-8b0b23fb4c1f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:03.638694 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-0be53e6b-74ae-4740-8cc4-8b0b23fb4c1f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:03.639900 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-0be53e6b-74ae-4740-8cc4-8b0b23fb4c1f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1731 microversion: 2.20 time: 0.169345 Aug 12 01:34:03.640465 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 413/822] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:34:03 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:34:04.673401 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-bf3110fe-c56e-4cba-a497-ad3398c6cd50 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:04.675380 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-bf3110fe-c56e-4cba-a497-ad3398c6cd50 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:04.682575 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bf3110fe-c56e-4cba-a497-ad3398c6cd50 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:04.683078 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bf3110fe-c56e-4cba-a497-ad3398c6cd50 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:04.683500 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bf3110fe-c56e-4cba-a497-ad3398c6cd50 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:04.684248 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bf3110fe-c56e-4cba-a497-ad3398c6cd50 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:04.684749 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bf3110fe-c56e-4cba-a497-ad3398c6cd50 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:04.685166 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-bf3110fe-c56e-4cba-a497-ad3398c6cd50 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:04.821284 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-bf3110fe-c56e-4cba-a497-ad3398c6cd50 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:04.829378 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-bf3110fe-c56e-4cba-a497-ad3398c6cd50 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:04.830925 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-bf3110fe-c56e-4cba-a497-ad3398c6cd50 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:04.832125 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-bf3110fe-c56e-4cba-a497-ad3398c6cd50 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1731 microversion: 2.20 time: 0.165744 Aug 12 01:34:04.832681 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 410/823] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:34:04 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:34:05.854753 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-f3e213a0-2f45-47f5-a81b-e47fe0da4383 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:05.855372 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-f3e213a0-2f45-47f5-a81b-e47fe0da4383 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:05.861927 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f3e213a0-2f45-47f5-a81b-e47fe0da4383 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:05.862446 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f3e213a0-2f45-47f5-a81b-e47fe0da4383 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:05.862902 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f3e213a0-2f45-47f5-a81b-e47fe0da4383 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:05.863621 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f3e213a0-2f45-47f5-a81b-e47fe0da4383 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:05.864070 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f3e213a0-2f45-47f5-a81b-e47fe0da4383 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:05.864486 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f3e213a0-2f45-47f5-a81b-e47fe0da4383 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:06.011238 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-f3e213a0-2f45-47f5-a81b-e47fe0da4383 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:06.019574 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-f3e213a0-2f45-47f5-a81b-e47fe0da4383 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:06.021022 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-f3e213a0-2f45-47f5-a81b-e47fe0da4383 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:06.022182 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-f3e213a0-2f45-47f5-a81b-e47fe0da4383 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1731 microversion: 2.20 time: 0.171502 Aug 12 01:34:06.022748 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 414/824] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:34:05 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:34:07.044685 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-4827624f-9764-4c7a-8a2f-faae03fadbda tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:07.045349 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-4827624f-9764-4c7a-8a2f-faae03fadbda tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:07.052515 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4827624f-9764-4c7a-8a2f-faae03fadbda tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:07.053004 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4827624f-9764-4c7a-8a2f-faae03fadbda tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:07.053433 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4827624f-9764-4c7a-8a2f-faae03fadbda tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:07.054125 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4827624f-9764-4c7a-8a2f-faae03fadbda tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:07.054571 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4827624f-9764-4c7a-8a2f-faae03fadbda tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:07.055010 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4827624f-9764-4c7a-8a2f-faae03fadbda tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:07.197038 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-4827624f-9764-4c7a-8a2f-faae03fadbda tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:07.205574 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-4827624f-9764-4c7a-8a2f-faae03fadbda tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:07.207125 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-4827624f-9764-4c7a-8a2f-faae03fadbda tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:07.208434 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-4827624f-9764-4c7a-8a2f-faae03fadbda tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1718 microversion: 2.20 time: 0.167639 Aug 12 01:34:07.209028 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 411/825] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:34:07 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1718 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:34:09.256250 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-24e699f6-2b8f-4ec5-a456-17d3b50d182b tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:09.258372 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-24e699f6-2b8f-4ec5-a456-17d3b50d182b tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: 30c8fb82-5cf9-4388-8481-285e8a09c261] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:09.265147 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-24e699f6-2b8f-4ec5-a456-17d3b50d182b tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:09.265624 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-24e699f6-2b8f-4ec5-a456-17d3b50d182b tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:09.266052 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-24e699f6-2b8f-4ec5-a456-17d3b50d182b tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:09.266732 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-24e699f6-2b8f-4ec5-a456-17d3b50d182b tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:09.267171 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-24e699f6-2b8f-4ec5-a456-17d3b50d182b tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:09.267582 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-24e699f6-2b8f-4ec5-a456-17d3b50d182b tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:09.298659 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-24e699f6-2b8f-4ec5-a456-17d3b50d182b tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046400 Aug 12 01:34:09.299424 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 415/826] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 01:34:09 2022] GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:34:09.448006 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-cceb8666-4418-424d-8c60-71f1f31296e4 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:09.448767 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-cceb8666-4418-424d-8c60-71f1f31296e4 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: 30c8fb82-5cf9-4388-8481-285e8a09c261] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:09.458250 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cceb8666-4418-424d-8c60-71f1f31296e4 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:09.458966 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cceb8666-4418-424d-8c60-71f1f31296e4 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:09.459598 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cceb8666-4418-424d-8c60-71f1f31296e4 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:09.460600 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cceb8666-4418-424d-8c60-71f1f31296e4 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:09.461242 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cceb8666-4418-424d-8c60-71f1f31296e4 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:09.461837 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cceb8666-4418-424d-8c60-71f1f31296e4 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:09.492598 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-cceb8666-4418-424d-8c60-71f1f31296e4 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261/os-volume_attachments/147cb519-62a1-4422-a117-84502da68d6b" status: 200 len: 194 microversion: 2.1 time: 0.050401 Aug 12 01:34:09.493338 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 412/827] 10.222.0.20 () {58 vars in 1413 bytes} [Fri Aug 12 01:34:09 2022] GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261/os-volume_attachments/147cb519-62a1-4422-a117-84502da68d6b => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:34:09.503788 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-3e0f107a-cce7-4e2f-b130-7cb00e8c86f5 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:09.504274 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-3e0f107a-cce7-4e2f-b130-7cb00e8c86f5 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: 30c8fb82-5cf9-4388-8481-285e8a09c261] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:09.510391 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3e0f107a-cce7-4e2f-b130-7cb00e8c86f5 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:09.510868 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3e0f107a-cce7-4e2f-b130-7cb00e8c86f5 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:09.511293 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3e0f107a-cce7-4e2f-b130-7cb00e8c86f5 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:09.512011 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3e0f107a-cce7-4e2f-b130-7cb00e8c86f5 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:09.512456 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3e0f107a-cce7-4e2f-b130-7cb00e8c86f5 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:09.512886 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3e0f107a-cce7-4e2f-b130-7cb00e8c86f5 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:09.591837 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.objects.instance [None req-3e0f107a-cce7-4e2f-b130-7cb00e8c86f5 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lazy-loading 'services' on Instance uuid 30c8fb82-5cf9-4388-8481-285e8a09c261 {{(pid=120786) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 01:34:09.676154 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-3e0f107a-cce7-4e2f-b130-7cb00e8c86f5 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "DELETE /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261/os-volume_attachments/147cb519-62a1-4422-a117-84502da68d6b" status: 202 len: 0 microversion: 2.1 time: 0.176191 Aug 12 01:34:09.676746 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 416/828] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Aug 12 01:34:09 2022] DELETE /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261/os-volume_attachments/147cb519-62a1-4422-a117-84502da68d6b => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 01:34:10.808375 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-0c04a930-5707-4318-893a-5167f535414a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:10.808942 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-0c04a930-5707-4318-893a-5167f535414a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: 30c8fb82-5cf9-4388-8481-285e8a09c261] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:10.816825 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0c04a930-5707-4318-893a-5167f535414a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:10.817350 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0c04a930-5707-4318-893a-5167f535414a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:10.817777 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0c04a930-5707-4318-893a-5167f535414a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:10.818700 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0c04a930-5707-4318-893a-5167f535414a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:10.819145 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0c04a930-5707-4318-893a-5167f535414a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:10.819601 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0c04a930-5707-4318-893a-5167f535414a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:10.851629 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-0c04a930-5707-4318-893a-5167f535414a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261/os-volume_attachments/53cadd07-a46b-4e1e-97b1-f3c239fe6d20" status: 200 len: 194 microversion: 2.1 time: 0.047189 Aug 12 01:34:10.852216 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 413/829] 10.222.0.20 () {58 vars in 1413 bytes} [Fri Aug 12 01:34:10 2022] GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261/os-volume_attachments/53cadd07-a46b-4e1e-97b1-f3c239fe6d20 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:34:10.864103 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-b383178b-ba7b-4bae-8b8a-92d06d870e5a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:10.864694 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-b383178b-ba7b-4bae-8b8a-92d06d870e5a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: 30c8fb82-5cf9-4388-8481-285e8a09c261] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:10.871064 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b383178b-ba7b-4bae-8b8a-92d06d870e5a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:10.871568 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b383178b-ba7b-4bae-8b8a-92d06d870e5a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:10.871990 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b383178b-ba7b-4bae-8b8a-92d06d870e5a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:10.872674 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b383178b-ba7b-4bae-8b8a-92d06d870e5a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:10.873112 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b383178b-ba7b-4bae-8b8a-92d06d870e5a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:10.873529 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b383178b-ba7b-4bae-8b8a-92d06d870e5a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:10.958711 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.objects.instance [None req-b383178b-ba7b-4bae-8b8a-92d06d870e5a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lazy-loading 'services' on Instance uuid 30c8fb82-5cf9-4388-8481-285e8a09c261 {{(pid=120786) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 01:34:11.034771 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-b383178b-ba7b-4bae-8b8a-92d06d870e5a tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "DELETE /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261/os-volume_attachments/53cadd07-a46b-4e1e-97b1-f3c239fe6d20" status: 202 len: 0 microversion: 2.1 time: 0.175627 Aug 12 01:34:11.035387 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 417/830] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Aug 12 01:34:10 2022] DELETE /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261/os-volume_attachments/53cadd07-a46b-4e1e-97b1-f3c239fe6d20 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 01:34:12.207525 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-309cc21b-2c0f-4842-a54a-3fb74764db66 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:12.210101 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-309cc21b-2c0f-4842-a54a-3fb74764db66 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: 30c8fb82-5cf9-4388-8481-285e8a09c261] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:12.216981 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-309cc21b-2c0f-4842-a54a-3fb74764db66 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:12.217460 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-309cc21b-2c0f-4842-a54a-3fb74764db66 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:12.217919 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-309cc21b-2c0f-4842-a54a-3fb74764db66 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:12.218621 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-309cc21b-2c0f-4842-a54a-3fb74764db66 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:12.219030 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-309cc21b-2c0f-4842-a54a-3fb74764db66 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:12.219442 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-309cc21b-2c0f-4842-a54a-3fb74764db66 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:12.249873 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-309cc21b-2c0f-4842-a54a-3fb74764db66 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046381 Aug 12 01:34:12.250494 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 414/831] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 01:34:12 2022] GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 01:34:12.371189 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-3832ff09-c073-4783-9625-26b6dcc6e18d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:12.373684 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-3832ff09-c073-4783-9625-26b6dcc6e18d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: 30c8fb82-5cf9-4388-8481-285e8a09c261] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:12.380598 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3832ff09-c073-4783-9625-26b6dcc6e18d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:12.381084 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3832ff09-c073-4783-9625-26b6dcc6e18d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:12.381517 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3832ff09-c073-4783-9625-26b6dcc6e18d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:12.382225 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3832ff09-c073-4783-9625-26b6dcc6e18d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:12.382710 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3832ff09-c073-4783-9625-26b6dcc6e18d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:12.383132 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3832ff09-c073-4783-9625-26b6dcc6e18d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:12.409184 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:34:12.414847 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-3832ff09-c073-4783-9625-26b6dcc6e18d tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048794 Aug 12 01:34:12.415466 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 418/832] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 01:34:12 2022] GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 01:34:12.475560 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-539b8928-de7e-4c72-8f63-2d7ffa88cd08 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:12.476055 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-539b8928-de7e-4c72-8f63-2d7ffa88cd08 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: 30c8fb82-5cf9-4388-8481-285e8a09c261] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:12.482073 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-539b8928-de7e-4c72-8f63-2d7ffa88cd08 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:12.482542 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-539b8928-de7e-4c72-8f63-2d7ffa88cd08 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:12.482966 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-539b8928-de7e-4c72-8f63-2d7ffa88cd08 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:12.483677 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-539b8928-de7e-4c72-8f63-2d7ffa88cd08 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:12.484116 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-539b8928-de7e-4c72-8f63-2d7ffa88cd08 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:12.484527 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-539b8928-de7e-4c72-8f63-2d7ffa88cd08 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:12.508878 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-539b8928-de7e-4c72-8f63-2d7ffa88cd08 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: 30c8fb82-5cf9-4388-8481-285e8a09c261] Going to try to terminate instance {{(pid=120785) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 01:34:12.586763 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-539b8928-de7e-4c72-8f63-2d7ffa88cd08 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "DELETE /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261" status: 204 len: 0 microversion: 2.1 time: 0.114790 Aug 12 01:34:12.587338 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 415/833] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 01:34:12 2022] DELETE /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 01:34:12.596537 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-02782b41-ef61-48f7-bcc8-71a4b08ef045 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:12.597368 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-02782b41-ef61-48f7-bcc8-71a4b08ef045 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: 30c8fb82-5cf9-4388-8481-285e8a09c261] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:12.604323 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-02782b41-ef61-48f7-bcc8-71a4b08ef045 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:12.604885 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-02782b41-ef61-48f7-bcc8-71a4b08ef045 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:12.605506 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-02782b41-ef61-48f7-bcc8-71a4b08ef045 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:12.606301 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-02782b41-ef61-48f7-bcc8-71a4b08ef045 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:12.606855 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-02782b41-ef61-48f7-bcc8-71a4b08ef045 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:12.607374 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-02782b41-ef61-48f7-bcc8-71a4b08ef045 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:12.743391 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-02782b41-ef61-48f7-bcc8-71a4b08ef045 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:12.751567 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-02782b41-ef61-48f7-bcc8-71a4b08ef045 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261" status: 200 len: 1671 microversion: 2.1 time: 0.159125 Aug 12 01:34:12.752176 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 419/834] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:34:12 2022] GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261 => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:34:13.777966 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-9d59796c-6f52-4f48-8d37-32a635cc98e5 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:13.779118 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-9d59796c-6f52-4f48-8d37-32a635cc98e5 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: 30c8fb82-5cf9-4388-8481-285e8a09c261] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:13.788539 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9d59796c-6f52-4f48-8d37-32a635cc98e5 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:13.789015 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9d59796c-6f52-4f48-8d37-32a635cc98e5 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:13.789465 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9d59796c-6f52-4f48-8d37-32a635cc98e5 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:13.790154 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9d59796c-6f52-4f48-8d37-32a635cc98e5 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:13.790591 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9d59796c-6f52-4f48-8d37-32a635cc98e5 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:13.791005 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9d59796c-6f52-4f48-8d37-32a635cc98e5 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:13.932271 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-9d59796c-6f52-4f48-8d37-32a635cc98e5 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:13.943985 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-9d59796c-6f52-4f48-8d37-32a635cc98e5 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261" status: 200 len: 1671 microversion: 2.1 time: 0.172718 Aug 12 01:34:13.944818 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 416/835] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:34:13 2022] GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261 => generated 1671 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:34:14.966032 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-de2013f9-b406-4fb9-8b9c-f49f846a81ab tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:14.966591 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-de2013f9-b406-4fb9-8b9c-f49f846a81ab tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: 30c8fb82-5cf9-4388-8481-285e8a09c261] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:14.973554 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-de2013f9-b406-4fb9-8b9c-f49f846a81ab tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:14.974040 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-de2013f9-b406-4fb9-8b9c-f49f846a81ab tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:14.974471 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-de2013f9-b406-4fb9-8b9c-f49f846a81ab tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:14.975164 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-de2013f9-b406-4fb9-8b9c-f49f846a81ab tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:14.975625 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-de2013f9-b406-4fb9-8b9c-f49f846a81ab tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:14.976067 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-de2013f9-b406-4fb9-8b9c-f49f846a81ab tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:15.124363 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-de2013f9-b406-4fb9-8b9c-f49f846a81ab tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:15.132071 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-de2013f9-b406-4fb9-8b9c-f49f846a81ab tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261" status: 200 len: 1671 microversion: 2.1 time: 0.170006 Aug 12 01:34:15.132635 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 420/836] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:34:14 2022] GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261 => generated 1671 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:34:15.716224 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-399dee64-0226-4f6b-b3c4-ecb9eebacdb6 req-95376566-321e-4fad-88f5-a81a8a3d44d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c8fb82-5cf9-4388-8481-285e8a09c261", "name": "network-vif-deleted", "tag": "8c964826-a690-4806-b18b-226a035ba086"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:34:15.726149 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-399dee64-0226-4f6b-b3c4-ecb9eebacdb6 req-95376566-321e-4fad-88f5-a81a8a3d44d5 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:15.726619 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-399dee64-0226-4f6b-b3c4-ecb9eebacdb6 req-95376566-321e-4fad-88f5-a81a8a3d44d5 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:15.727042 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-399dee64-0226-4f6b-b3c4-ecb9eebacdb6 req-95376566-321e-4fad-88f5-a81a8a3d44d5 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:15.738268 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-399dee64-0226-4f6b-b3c4-ecb9eebacdb6 req-95376566-321e-4fad-88f5-a81a8a3d44d5 service nova] Creating event network-vif-deleted:8c964826-a690-4806-b18b-226a035ba086 for instance 30c8fb82-5cf9-4388-8481-285e8a09c261 on hv-cinder-78481 Aug 12 01:34:15.743268 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-399dee64-0226-4f6b-b3c4-ecb9eebacdb6 req-95376566-321e-4fad-88f5-a81a8a3d44d5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030758 Aug 12 01:34:15.743871 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 417/837] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:34:16.153750 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-2a03565b-7261-4d95-a726-abd83c36536c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:16.154368 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-2a03565b-7261-4d95-a726-abd83c36536c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: 30c8fb82-5cf9-4388-8481-285e8a09c261] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:16.161691 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2a03565b-7261-4d95-a726-abd83c36536c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:16.162204 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2a03565b-7261-4d95-a726-abd83c36536c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:16.162613 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2a03565b-7261-4d95-a726-abd83c36536c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:16.163309 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2a03565b-7261-4d95-a726-abd83c36536c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:16.163785 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2a03565b-7261-4d95-a726-abd83c36536c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:16.164203 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2a03565b-7261-4d95-a726-abd83c36536c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:16.232670 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-2a03565b-7261-4d95-a726-abd83c36536c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:16.240927 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-2a03565b-7261-4d95-a726-abd83c36536c tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261" status: 200 len: 1604 microversion: 2.1 time: 0.091030 Aug 12 01:34:16.241525 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 421/838] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:34:16 2022] GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261 => generated 1604 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:34:17.268145 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-5eb89289-955b-4bfb-810d-2d47859aab7b tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:17.269286 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-5eb89289-955b-4bfb-810d-2d47859aab7b tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: 30c8fb82-5cf9-4388-8481-285e8a09c261] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:17.276339 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5eb89289-955b-4bfb-810d-2d47859aab7b tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:17.276812 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5eb89289-955b-4bfb-810d-2d47859aab7b tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:17.277240 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5eb89289-955b-4bfb-810d-2d47859aab7b tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:17.277911 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5eb89289-955b-4bfb-810d-2d47859aab7b tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:17.278357 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5eb89289-955b-4bfb-810d-2d47859aab7b tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:17.278770 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-5eb89289-955b-4bfb-810d-2d47859aab7b tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:17.348209 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-5eb89289-955b-4bfb-810d-2d47859aab7b tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:17.356391 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-5eb89289-955b-4bfb-810d-2d47859aab7b tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261" status: 200 len: 1604 microversion: 2.1 time: 0.096098 Aug 12 01:34:17.356968 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 418/839] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:34:17 2022] GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261 => generated 1604 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:34:18.303028 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-b366218a-04ea-470e-a162-4fb04ccb0cb3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:18.303765 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-b366218a-04ea-470e-a162-4fb04ccb0cb3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 2bb87cca-3f2d-4017-9cb9-1f309cdaacac] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:18.312064 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b366218a-04ea-470e-a162-4fb04ccb0cb3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:18.312666 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b366218a-04ea-470e-a162-4fb04ccb0cb3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:18.313199 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b366218a-04ea-470e-a162-4fb04ccb0cb3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:18.314055 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b366218a-04ea-470e-a162-4fb04ccb0cb3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:18.314612 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b366218a-04ea-470e-a162-4fb04ccb0cb3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:18.315147 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b366218a-04ea-470e-a162-4fb04ccb0cb3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:18.338581 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-b366218a-04ea-470e-a162-4fb04ccb0cb3 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac/ips" status: 200 len: 151 microversion: 2.1 time: 0.040816 Aug 12 01:34:18.339141 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 422/840] 10.222.0.20 () {58 vars in 1248 bytes} [Fri Aug 12 01:34:18 2022] GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:34:18.378393 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-7bd047ea-e6a5-4576-93aa-81df691b0073 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:18.378782 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-7bd047ea-e6a5-4576-93aa-81df691b0073 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: 30c8fb82-5cf9-4388-8481-285e8a09c261] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:18.385803 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7bd047ea-e6a5-4576-93aa-81df691b0073 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:18.386281 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7bd047ea-e6a5-4576-93aa-81df691b0073 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:18.386891 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7bd047ea-e6a5-4576-93aa-81df691b0073 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:18.387581 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7bd047ea-e6a5-4576-93aa-81df691b0073 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:18.388365 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7bd047ea-e6a5-4576-93aa-81df691b0073 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:18.388868 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7bd047ea-e6a5-4576-93aa-81df691b0073 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:18.419935 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7bd047ea-e6a5-4576-93aa-81df691b0073 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:18.420402 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7bd047ea-e6a5-4576-93aa-81df691b0073 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:18.420826 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7bd047ea-e6a5-4576-93aa-81df691b0073 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:18.421260 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.objects.instance [None req-7bd047ea-e6a5-4576-93aa-81df691b0073 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lazy-loading 'fault' on Instance uuid 30c8fb82-5cf9-4388-8481-285e8a09c261 {{(pid=120785) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 01:34:18.464642 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-7bd047ea-e6a5-4576-93aa-81df691b0073 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '605b0b202a3b44c7aa227c1b97193365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb834d06ed94c1993ec0f7130d97803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:18.473035 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-7bd047ea-e6a5-4576-93aa-81df691b0073 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261" status: 200 len: 1327 microversion: 2.1 time: 0.099119 Aug 12 01:34:18.473612 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 419/841] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:34:18 2022] GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261 => generated 1327 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:34:19.494445 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-53021b9c-f5f3-42f9-a9d9-acb43a7dd8df tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:19.495060 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-53021b9c-f5f3-42f9-a9d9-acb43a7dd8df tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: 30c8fb82-5cf9-4388-8481-285e8a09c261] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:19.501654 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-53021b9c-f5f3-42f9-a9d9-acb43a7dd8df tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:19.502128 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-53021b9c-f5f3-42f9-a9d9-acb43a7dd8df tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:19.502551 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-53021b9c-f5f3-42f9-a9d9-acb43a7dd8df tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:19.503225 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-53021b9c-f5f3-42f9-a9d9-acb43a7dd8df tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:19.503694 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-53021b9c-f5f3-42f9-a9d9-acb43a7dd8df tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:19.504141 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-53021b9c-f5f3-42f9-a9d9-acb43a7dd8df tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:19.517589 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.wsgi [None req-53021b9c-f5f3-42f9-a9d9-acb43a7dd8df tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] HTTP exception thrown: Instance 30c8fb82-5cf9-4388-8481-285e8a09c261 could not be found. Aug 12 01:34:19.519190 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-53021b9c-f5f3-42f9-a9d9-acb43a7dd8df tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Request method failure captured: Aug 12 01:34:19.519190 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: request: GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261 HTTP/1.1 Aug 12 01:34:19.519190 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept: application/json Aug 12 01:34:19.519190 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept-Encoding: identity Aug 12 01:34:19.519190 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Connection: close Aug 12 01:34:19.519190 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Length: 0 Aug 12 01:34:19.519190 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Type: application/json Aug 12 01:34:19.519190 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Host: 10.222.0.20 Aug 12 01:34:19.519190 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Openstack-System-Scope: None Aug 12 01:34:19.519190 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: User-Agent: python-urllib3/1.26.11 Aug 12 01:34:19.519190 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Auth-Token: gAAAAABi9ayskh2QdkEN5AsDjgVGNCXEoYZB0mwI3UKbkhVB-xgOT7ahyRjRMHIM6lPE15MPlDJhYjTUgsjx8wgW2blzPFOHnB1Cl4V5skiuQt2vjs7BmFNk8l8MeY2vdlIJArTl_MMJVkV0P8Cj7dMTnnGQmjZ8u3WuHUiEXmTSSa0aqTBvkSA Aug 12 01:34:19.519190 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Id: None Aug 12 01:34:19.519190 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Name: None Aug 12 01:34:19.519190 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Identity-Status: Confirmed Aug 12 01:34:19.519190 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Is-Admin-Project: True Aug 12 01:34:19.519190 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Id: default Aug 12 01:34:19.519190 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Name: Default Aug 12 01:34:19.519190 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Id: 0cb834d06ed94c1993ec0f7130d97803 Aug 12 01:34:19.519190 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Name: tempest-AttachVolumeTestJSON-275393966 Aug 12 01:34:19.519190 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Role: member,reader Aug 12 01:34:19.519190 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Roles: member,reader Aug 12 01:34:19.520899 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0cb834d06ed94c1993ec0f7130d97803"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0cb834d06ed94c1993ec0f7130d97803"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0cb834d06ed94c1993ec0f7130d97803"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0cb834d06ed94c1993ec0f7130d97803"}]}] Aug 12 01:34:19.520899 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant: tempest-AttachVolumeTestJSON-275393966 Aug 12 01:34:19.520899 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Id: 0cb834d06ed94c1993ec0f7130d97803 Aug 12 01:34:19.520899 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Name: tempest-AttachVolumeTestJSON-275393966 Aug 12 01:34:19.520899 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User: tempest-AttachVolumeTestJSON-275393966-project Aug 12 01:34:19.520899 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Id: default Aug 12 01:34:19.520899 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Name: Default Aug 12 01:34:19.520899 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Id: 605b0b202a3b44c7aa227c1b97193365 Aug 12 01:34:19.520899 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Name: tempest-AttachVolumeTestJSON-275393966-project Aug 12 01:34:19.520899 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: method: > Aug 12 01:34:19.520899 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: exception: Instance 30c8fb82-5cf9-4388-8481-285e8a09c261 could not be found. Aug 12 01:34:19.520899 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: action_args: {'id': '30c8fb82-5cf9-4388-8481-285e8a09c261'} Aug 12 01:34:19.521991 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:34:19.521991 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:19.521991 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:34:19.521991 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:34:19.521991 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:34:19.521991 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:34:19.521991 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:34:19.521991 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:34:19.521991 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:34:19.521991 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:34:19.521991 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30c8fb82-5cf9-4388-8481-285e8a09c261 could not be found. Aug 12 01:34:19.521991 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:19.521991 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:34:19.521991 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:19.521991 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:19.521991 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:34:19.521991 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:34:19.521991 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:34:19.521991 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:34:19.521991 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:34:19.523470 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:34:19.523470 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 01:34:19.523470 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 01:34:19.523470 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:34:19.523470 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:34:19.523470 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:34:19.523470 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:34:19.523470 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30c8fb82-5cf9-4388-8481-285e8a09c261 could not be found. Aug 12 01:34:19.523470 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:19.523470 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:34:19.523470 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:19.523470 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:19.523470 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:34:19.523470 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:34:19.523470 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:34:19.523470 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:34:19.523470 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30c8fb82-5cf9-4388-8481-285e8a09c261 could not be found. Aug 12 01:34:19.523470 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:19.525012 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-53021b9c-f5f3-42f9-a9d9-acb43a7dd8df tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Returning 404 to user: Instance 30c8fb82-5cf9-4388-8481-285e8a09c261 could not be found. {{(pid=120786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:34:19.525012 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-53021b9c-f5f3-42f9-a9d9-acb43a7dd8df tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261" status: 404 len: 111 microversion: 2.1 time: 0.030126 Aug 12 01:34:19.525012 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 423/842] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:34:19 2022] GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:34:19.529611 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-af7c6518-8b58-4c7d-836b-558d3e862df3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '.version_select at 0x7f2deccaf160>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:19.551660 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-af7c6518-8b58-4c7d-836b-558d3e862df3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1627478485" status: 202 len: 0 microversion: 2.1 time: 0.025841 Aug 12 01:34:19.552513 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 420/843] 10.222.0.20 () {58 vars in 1221 bytes} [Fri Aug 12 01:34:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1627478485 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 01:34:19.686380 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-9a0dad70-3688-4783-861d-8948ef09583e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5cae1616-808e-4a4c-a9ae-9a9fbfe4ecf2"}} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:34:19.689428 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-9a0dad70-3688-4783-861d-8948ef09583e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 2bb87cca-3f2d-4017-9cb9-1f309cdaacac] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:19.695678 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9a0dad70-3688-4783-861d-8948ef09583e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:19.696164 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9a0dad70-3688-4783-861d-8948ef09583e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:19.696594 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9a0dad70-3688-4783-861d-8948ef09583e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:19.697288 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9a0dad70-3688-4783-861d-8948ef09583e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:19.697741 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9a0dad70-3688-4783-861d-8948ef09583e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:19.698155 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9a0dad70-3688-4783-861d-8948ef09583e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:19.955191 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-9a0dad70-3688-4783-861d-8948ef09583e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "POST /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273098 Aug 12 01:34:19.955875 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 424/844] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Aug 12 01:34:19 2022] POST /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:34:22.651405 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-ed22c211-36b2-4cec-adc3-18098623c7f3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:22.651992 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-ed22c211-36b2-4cec-adc3-18098623c7f3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: 30c8fb82-5cf9-4388-8481-285e8a09c261] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:22.658171 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ed22c211-36b2-4cec-adc3-18098623c7f3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:22.658658 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ed22c211-36b2-4cec-adc3-18098623c7f3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:22.659088 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ed22c211-36b2-4cec-adc3-18098623c7f3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:22.659799 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ed22c211-36b2-4cec-adc3-18098623c7f3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:22.660249 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ed22c211-36b2-4cec-adc3-18098623c7f3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:22.660667 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ed22c211-36b2-4cec-adc3-18098623c7f3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:22.674378 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.wsgi [None req-ed22c211-36b2-4cec-adc3-18098623c7f3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] HTTP exception thrown: Instance 30c8fb82-5cf9-4388-8481-285e8a09c261 could not be found. Aug 12 01:34:22.676055 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-ed22c211-36b2-4cec-adc3-18098623c7f3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Request method failure captured: Aug 12 01:34:22.676055 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: request: DELETE /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261 HTTP/1.1 Aug 12 01:34:22.676055 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept: application/json Aug 12 01:34:22.676055 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept-Encoding: identity Aug 12 01:34:22.676055 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Connection: close Aug 12 01:34:22.676055 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Length: 0 Aug 12 01:34:22.676055 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Type: application/json Aug 12 01:34:22.676055 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Host: 10.222.0.20 Aug 12 01:34:22.676055 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Openstack-System-Scope: None Aug 12 01:34:22.676055 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: User-Agent: python-urllib3/1.26.11 Aug 12 01:34:22.676055 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Auth-Token: gAAAAABi9ayskh2QdkEN5AsDjgVGNCXEoYZB0mwI3UKbkhVB-xgOT7ahyRjRMHIM6lPE15MPlDJhYjTUgsjx8wgW2blzPFOHnB1Cl4V5skiuQt2vjs7BmFNk8l8MeY2vdlIJArTl_MMJVkV0P8Cj7dMTnnGQmjZ8u3WuHUiEXmTSSa0aqTBvkSA Aug 12 01:34:22.676055 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Id: None Aug 12 01:34:22.676055 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Name: None Aug 12 01:34:22.676055 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Identity-Status: Confirmed Aug 12 01:34:22.676055 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Is-Admin-Project: True Aug 12 01:34:22.676055 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Id: default Aug 12 01:34:22.676055 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Name: Default Aug 12 01:34:22.676055 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Id: 0cb834d06ed94c1993ec0f7130d97803 Aug 12 01:34:22.676055 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Name: tempest-AttachVolumeTestJSON-275393966 Aug 12 01:34:22.676055 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Role: member,reader Aug 12 01:34:22.676055 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Roles: member,reader Aug 12 01:34:22.677934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0cb834d06ed94c1993ec0f7130d97803"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0cb834d06ed94c1993ec0f7130d97803"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0cb834d06ed94c1993ec0f7130d97803"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0cb834d06ed94c1993ec0f7130d97803"}]}] Aug 12 01:34:22.677934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant: tempest-AttachVolumeTestJSON-275393966 Aug 12 01:34:22.677934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Id: 0cb834d06ed94c1993ec0f7130d97803 Aug 12 01:34:22.677934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Name: tempest-AttachVolumeTestJSON-275393966 Aug 12 01:34:22.677934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User: tempest-AttachVolumeTestJSON-275393966-project Aug 12 01:34:22.677934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Id: default Aug 12 01:34:22.677934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Name: Default Aug 12 01:34:22.677934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Id: 605b0b202a3b44c7aa227c1b97193365 Aug 12 01:34:22.677934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Name: tempest-AttachVolumeTestJSON-275393966-project Aug 12 01:34:22.677934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: method: > Aug 12 01:34:22.677934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: exception: Instance 30c8fb82-5cf9-4388-8481-285e8a09c261 could not be found. Aug 12 01:34:22.677934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: action_args: {'id': '30c8fb82-5cf9-4388-8481-285e8a09c261'} Aug 12 01:34:22.678786 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:34:22.678786 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:22.678786 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:34:22.678786 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:34:22.678786 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:34:22.678786 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:34:22.678786 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:34:22.678786 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:34:22.678786 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:34:22.678786 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:34:22.678786 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30c8fb82-5cf9-4388-8481-285e8a09c261 could not be found. Aug 12 01:34:22.678786 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:22.678786 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:34:22.678786 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:22.678786 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:22.678786 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:34:22.678786 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:34:22.678786 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:34:22.678786 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:34:22.678786 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:34:22.680184 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:34:22.680184 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 01:34:22.680184 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 01:34:22.680184 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 01:34:22.680184 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 01:34:22.680184 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:34:22.680184 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:34:22.680184 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:34:22.680184 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:34:22.680184 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30c8fb82-5cf9-4388-8481-285e8a09c261 could not be found. Aug 12 01:34:22.680184 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:22.680184 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:34:22.680184 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:22.680184 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:22.680184 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:34:22.680184 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:34:22.680184 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:34:22.680184 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:34:22.680184 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30c8fb82-5cf9-4388-8481-285e8a09c261 could not be found. Aug 12 01:34:22.680184 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:22.681709 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-ed22c211-36b2-4cec-adc3-18098623c7f3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Returning 404 to user: Instance 30c8fb82-5cf9-4388-8481-285e8a09c261 could not be found. {{(pid=120785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:34:22.681709 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-ed22c211-36b2-4cec-adc3-18098623c7f3 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "DELETE /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261" status: 404 len: 111 microversion: 2.1 time: 0.031043 Aug 12 01:34:22.681709 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 421/845] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 01:34:22 2022] DELETE /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:34:22.687652 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-e52d9996-56c3-4b7f-a11b-d38929413ea0 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:22.688340 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-e52d9996-56c3-4b7f-a11b-d38929413ea0 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: 30c8fb82-5cf9-4388-8481-285e8a09c261] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:22.694824 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e52d9996-56c3-4b7f-a11b-d38929413ea0 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:22.695298 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e52d9996-56c3-4b7f-a11b-d38929413ea0 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:22.695767 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e52d9996-56c3-4b7f-a11b-d38929413ea0 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:22.696420 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e52d9996-56c3-4b7f-a11b-d38929413ea0 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:22.697081 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e52d9996-56c3-4b7f-a11b-d38929413ea0 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:22.697503 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e52d9996-56c3-4b7f-a11b-d38929413ea0 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:22.710820 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.wsgi [None req-e52d9996-56c3-4b7f-a11b-d38929413ea0 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] HTTP exception thrown: Instance 30c8fb82-5cf9-4388-8481-285e8a09c261 could not be found. Aug 12 01:34:22.712468 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-e52d9996-56c3-4b7f-a11b-d38929413ea0 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Request method failure captured: Aug 12 01:34:22.712468 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: request: GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261 HTTP/1.1 Aug 12 01:34:22.712468 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept: application/json Aug 12 01:34:22.712468 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept-Encoding: identity Aug 12 01:34:22.712468 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Connection: close Aug 12 01:34:22.712468 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Length: 0 Aug 12 01:34:22.712468 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Type: application/json Aug 12 01:34:22.712468 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Host: 10.222.0.20 Aug 12 01:34:22.712468 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Openstack-System-Scope: None Aug 12 01:34:22.712468 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: User-Agent: python-urllib3/1.26.11 Aug 12 01:34:22.712468 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Auth-Token: gAAAAABi9ayskh2QdkEN5AsDjgVGNCXEoYZB0mwI3UKbkhVB-xgOT7ahyRjRMHIM6lPE15MPlDJhYjTUgsjx8wgW2blzPFOHnB1Cl4V5skiuQt2vjs7BmFNk8l8MeY2vdlIJArTl_MMJVkV0P8Cj7dMTnnGQmjZ8u3WuHUiEXmTSSa0aqTBvkSA Aug 12 01:34:22.712468 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Id: None Aug 12 01:34:22.712468 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Name: None Aug 12 01:34:22.712468 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Identity-Status: Confirmed Aug 12 01:34:22.712468 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Is-Admin-Project: True Aug 12 01:34:22.712468 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Id: default Aug 12 01:34:22.712468 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Name: Default Aug 12 01:34:22.712468 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Id: 0cb834d06ed94c1993ec0f7130d97803 Aug 12 01:34:22.712468 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Name: tempest-AttachVolumeTestJSON-275393966 Aug 12 01:34:22.712468 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Role: member,reader Aug 12 01:34:22.712468 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Roles: member,reader Aug 12 01:34:22.713998 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0cb834d06ed94c1993ec0f7130d97803"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0cb834d06ed94c1993ec0f7130d97803"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0cb834d06ed94c1993ec0f7130d97803"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0cb834d06ed94c1993ec0f7130d97803"}]}] Aug 12 01:34:22.713998 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant: tempest-AttachVolumeTestJSON-275393966 Aug 12 01:34:22.713998 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Id: 0cb834d06ed94c1993ec0f7130d97803 Aug 12 01:34:22.713998 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Name: tempest-AttachVolumeTestJSON-275393966 Aug 12 01:34:22.713998 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User: tempest-AttachVolumeTestJSON-275393966-project Aug 12 01:34:22.713998 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Id: default Aug 12 01:34:22.713998 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Name: Default Aug 12 01:34:22.713998 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Id: 605b0b202a3b44c7aa227c1b97193365 Aug 12 01:34:22.713998 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Name: tempest-AttachVolumeTestJSON-275393966-project Aug 12 01:34:22.713998 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: method: > Aug 12 01:34:22.713998 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: exception: Instance 30c8fb82-5cf9-4388-8481-285e8a09c261 could not be found. Aug 12 01:34:22.713998 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: action_args: {'id': '30c8fb82-5cf9-4388-8481-285e8a09c261'} Aug 12 01:34:22.714915 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:34:22.714915 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:22.714915 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:34:22.714915 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:34:22.714915 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:34:22.714915 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:34:22.714915 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:34:22.714915 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:34:22.714915 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:34:22.714915 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:34:22.714915 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30c8fb82-5cf9-4388-8481-285e8a09c261 could not be found. Aug 12 01:34:22.714915 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:22.714915 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:34:22.714915 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:22.714915 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:22.714915 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:34:22.714915 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:34:22.714915 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:34:22.714915 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:34:22.714915 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:34:22.716595 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:34:22.716595 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 01:34:22.716595 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 01:34:22.716595 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:34:22.716595 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:34:22.716595 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:34:22.716595 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:34:22.716595 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30c8fb82-5cf9-4388-8481-285e8a09c261 could not be found. Aug 12 01:34:22.716595 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:22.716595 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:34:22.716595 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:22.716595 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:22.716595 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:34:22.716595 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:34:22.716595 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:34:22.716595 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:34:22.716595 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30c8fb82-5cf9-4388-8481-285e8a09c261 could not be found. Aug 12 01:34:22.716595 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:22.717962 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-e52d9996-56c3-4b7f-a11b-d38929413ea0 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Returning 404 to user: Instance 30c8fb82-5cf9-4388-8481-285e8a09c261 could not be found. {{(pid=120786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:34:22.717962 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-e52d9996-56c3-4b7f-a11b-d38929413ea0 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261" status: 404 len: 111 microversion: 2.1 time: 0.031086 Aug 12 01:34:22.717962 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 425/846] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:34:22 2022] GET /compute/v2.1/servers/30c8fb82-5cf9-4388-8481-285e8a09c261 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:34:25.979633 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-ea51672e-2f9a-4f69-9549-5f0b7ba17b89 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:25.980134 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-ea51672e-2f9a-4f69-9549-5f0b7ba17b89 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:25.986862 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ea51672e-2f9a-4f69-9549-5f0b7ba17b89 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:25.987589 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ea51672e-2f9a-4f69-9549-5f0b7ba17b89 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:25.987829 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ea51672e-2f9a-4f69-9549-5f0b7ba17b89 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:25.988530 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ea51672e-2f9a-4f69-9549-5f0b7ba17b89 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:25.988979 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ea51672e-2f9a-4f69-9549-5f0b7ba17b89 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:25.989405 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ea51672e-2f9a-4f69-9549-5f0b7ba17b89 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:26.003431 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.wsgi [None req-ea51672e-2f9a-4f69-9549-5f0b7ba17b89 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] HTTP exception thrown: Instance c4364ac0-a9b7-4650-8456-15ccdd39bc3a could not be found. Aug 12 01:34:26.005099 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-ea51672e-2f9a-4f69-9549-5f0b7ba17b89 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Request method failure captured: Aug 12 01:34:26.005099 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: request: DELETE /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a HTTP/1.1 Aug 12 01:34:26.005099 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept: application/json Aug 12 01:34:26.005099 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept-Encoding: identity Aug 12 01:34:26.005099 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Connection: close Aug 12 01:34:26.005099 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Length: 0 Aug 12 01:34:26.005099 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Type: application/json Aug 12 01:34:26.005099 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Host: 10.222.0.20 Aug 12 01:34:26.005099 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Openstack-System-Scope: None Aug 12 01:34:26.005099 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: User-Agent: python-urllib3/1.26.11 Aug 12 01:34:26.005099 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Auth-Token: gAAAAABi9ayskh2QdkEN5AsDjgVGNCXEoYZB0mwI3UKbkhVB-xgOT7ahyRjRMHIM6lPE15MPlDJhYjTUgsjx8wgW2blzPFOHnB1Cl4V5skiuQt2vjs7BmFNk8l8MeY2vdlIJArTl_MMJVkV0P8Cj7dMTnnGQmjZ8u3WuHUiEXmTSSa0aqTBvkSA Aug 12 01:34:26.005099 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Id: None Aug 12 01:34:26.005099 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Name: None Aug 12 01:34:26.005099 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Identity-Status: Confirmed Aug 12 01:34:26.005099 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Is-Admin-Project: True Aug 12 01:34:26.005099 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Id: default Aug 12 01:34:26.005099 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Name: Default Aug 12 01:34:26.005099 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Id: 0cb834d06ed94c1993ec0f7130d97803 Aug 12 01:34:26.005099 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Name: tempest-AttachVolumeTestJSON-275393966 Aug 12 01:34:26.005099 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Role: member,reader Aug 12 01:34:26.005099 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Roles: member,reader Aug 12 01:34:26.006687 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0cb834d06ed94c1993ec0f7130d97803"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0cb834d06ed94c1993ec0f7130d97803"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0cb834d06ed94c1993ec0f7130d97803"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0cb834d06ed94c1993ec0f7130d97803"}]}] Aug 12 01:34:26.006687 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant: tempest-AttachVolumeTestJSON-275393966 Aug 12 01:34:26.006687 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Id: 0cb834d06ed94c1993ec0f7130d97803 Aug 12 01:34:26.006687 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Name: tempest-AttachVolumeTestJSON-275393966 Aug 12 01:34:26.006687 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User: tempest-AttachVolumeTestJSON-275393966-project Aug 12 01:34:26.006687 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Id: default Aug 12 01:34:26.006687 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Name: Default Aug 12 01:34:26.006687 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Id: 605b0b202a3b44c7aa227c1b97193365 Aug 12 01:34:26.006687 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Name: tempest-AttachVolumeTestJSON-275393966-project Aug 12 01:34:26.006687 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: method: > Aug 12 01:34:26.006687 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: exception: Instance c4364ac0-a9b7-4650-8456-15ccdd39bc3a could not be found. Aug 12 01:34:26.006687 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: action_args: {'id': 'c4364ac0-a9b7-4650-8456-15ccdd39bc3a'} Aug 12 01:34:26.007625 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:34:26.007625 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:26.007625 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:34:26.007625 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:34:26.007625 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:34:26.007625 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:34:26.007625 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:34:26.007625 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:34:26.007625 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:34:26.007625 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:34:26.007625 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4364ac0-a9b7-4650-8456-15ccdd39bc3a could not be found. Aug 12 01:34:26.007625 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:26.007625 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:34:26.007625 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:26.007625 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:26.007625 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:34:26.007625 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:34:26.007625 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:34:26.007625 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:34:26.007625 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:34:26.008857 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:34:26.008857 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 01:34:26.008857 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 01:34:26.008857 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 01:34:26.008857 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 01:34:26.008857 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:34:26.008857 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:34:26.008857 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:34:26.008857 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:34:26.008857 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4364ac0-a9b7-4650-8456-15ccdd39bc3a could not be found. Aug 12 01:34:26.008857 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:26.008857 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:34:26.008857 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:26.008857 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:26.008857 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:34:26.008857 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:34:26.008857 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:34:26.008857 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:34:26.008857 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4364ac0-a9b7-4650-8456-15ccdd39bc3a could not be found. Aug 12 01:34:26.008857 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:26.010223 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-ea51672e-2f9a-4f69-9549-5f0b7ba17b89 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Returning 404 to user: Instance c4364ac0-a9b7-4650-8456-15ccdd39bc3a could not be found. {{(pid=120785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:34:26.010223 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-ea51672e-2f9a-4f69-9549-5f0b7ba17b89 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 404 len: 111 microversion: 2.1 time: 0.031844 Aug 12 01:34:26.010223 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 422/847] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 01:34:25 2022] DELETE /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 12 01:34:26.016059 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-165a2abe-36e4-4497-ac76-e66cddbe3c53 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:26.017001 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-165a2abe-36e4-4497-ac76-e66cddbe3c53 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] [instance: c4364ac0-a9b7-4650-8456-15ccdd39bc3a] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:26.024189 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-165a2abe-36e4-4497-ac76-e66cddbe3c53 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:26.024677 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-165a2abe-36e4-4497-ac76-e66cddbe3c53 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:26.025111 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-165a2abe-36e4-4497-ac76-e66cddbe3c53 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:26.025800 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-165a2abe-36e4-4497-ac76-e66cddbe3c53 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:26.026258 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-165a2abe-36e4-4497-ac76-e66cddbe3c53 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:26.026659 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-165a2abe-36e4-4497-ac76-e66cddbe3c53 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:26.040968 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.wsgi [None req-165a2abe-36e4-4497-ac76-e66cddbe3c53 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] HTTP exception thrown: Instance c4364ac0-a9b7-4650-8456-15ccdd39bc3a could not be found. Aug 12 01:34:26.042573 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-165a2abe-36e4-4497-ac76-e66cddbe3c53 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Request method failure captured: Aug 12 01:34:26.042573 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: request: GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a HTTP/1.1 Aug 12 01:34:26.042573 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept: application/json Aug 12 01:34:26.042573 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept-Encoding: identity Aug 12 01:34:26.042573 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Connection: close Aug 12 01:34:26.042573 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Length: 0 Aug 12 01:34:26.042573 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Type: application/json Aug 12 01:34:26.042573 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Host: 10.222.0.20 Aug 12 01:34:26.042573 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Openstack-System-Scope: None Aug 12 01:34:26.042573 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: User-Agent: python-urllib3/1.26.11 Aug 12 01:34:26.042573 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Auth-Token: gAAAAABi9ayskh2QdkEN5AsDjgVGNCXEoYZB0mwI3UKbkhVB-xgOT7ahyRjRMHIM6lPE15MPlDJhYjTUgsjx8wgW2blzPFOHnB1Cl4V5skiuQt2vjs7BmFNk8l8MeY2vdlIJArTl_MMJVkV0P8Cj7dMTnnGQmjZ8u3WuHUiEXmTSSa0aqTBvkSA Aug 12 01:34:26.042573 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Id: None Aug 12 01:34:26.042573 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Name: None Aug 12 01:34:26.042573 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Identity-Status: Confirmed Aug 12 01:34:26.042573 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Is-Admin-Project: True Aug 12 01:34:26.042573 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Id: default Aug 12 01:34:26.042573 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Name: Default Aug 12 01:34:26.042573 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Id: 0cb834d06ed94c1993ec0f7130d97803 Aug 12 01:34:26.042573 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Name: tempest-AttachVolumeTestJSON-275393966 Aug 12 01:34:26.042573 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Role: member,reader Aug 12 01:34:26.042573 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Roles: member,reader Aug 12 01:34:26.044027 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0cb834d06ed94c1993ec0f7130d97803"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0cb834d06ed94c1993ec0f7130d97803"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0cb834d06ed94c1993ec0f7130d97803"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0cb834d06ed94c1993ec0f7130d97803"}]}] Aug 12 01:34:26.044027 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant: tempest-AttachVolumeTestJSON-275393966 Aug 12 01:34:26.044027 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Id: 0cb834d06ed94c1993ec0f7130d97803 Aug 12 01:34:26.044027 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Name: tempest-AttachVolumeTestJSON-275393966 Aug 12 01:34:26.044027 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User: tempest-AttachVolumeTestJSON-275393966-project Aug 12 01:34:26.044027 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Id: default Aug 12 01:34:26.044027 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Name: Default Aug 12 01:34:26.044027 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Id: 605b0b202a3b44c7aa227c1b97193365 Aug 12 01:34:26.044027 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Name: tempest-AttachVolumeTestJSON-275393966-project Aug 12 01:34:26.044027 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: method: > Aug 12 01:34:26.044027 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: exception: Instance c4364ac0-a9b7-4650-8456-15ccdd39bc3a could not be found. Aug 12 01:34:26.044027 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: action_args: {'id': 'c4364ac0-a9b7-4650-8456-15ccdd39bc3a'} Aug 12 01:34:26.044801 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:34:26.044801 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:26.044801 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:34:26.044801 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:34:26.044801 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:34:26.044801 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:34:26.044801 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:34:26.044801 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:34:26.044801 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:34:26.044801 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:34:26.044801 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4364ac0-a9b7-4650-8456-15ccdd39bc3a could not be found. Aug 12 01:34:26.044801 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:26.044801 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:34:26.044801 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:26.044801 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:26.044801 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:34:26.044801 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:34:26.044801 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:34:26.044801 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:34:26.044801 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:34:26.046015 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:34:26.046015 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 01:34:26.046015 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 01:34:26.046015 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:34:26.046015 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:34:26.046015 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:34:26.046015 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:34:26.046015 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4364ac0-a9b7-4650-8456-15ccdd39bc3a could not be found. Aug 12 01:34:26.046015 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:26.046015 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:34:26.046015 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:26.046015 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:26.046015 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:34:26.046015 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:34:26.046015 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:34:26.046015 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:34:26.046015 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4364ac0-a9b7-4650-8456-15ccdd39bc3a could not be found. Aug 12 01:34:26.046015 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:26.047102 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-165a2abe-36e4-4497-ac76-e66cddbe3c53 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] Returning 404 to user: Instance c4364ac0-a9b7-4650-8456-15ccdd39bc3a could not be found. {{(pid=120786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:34:26.047102 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-165a2abe-36e4-4497-ac76-e66cddbe3c53 tempest-AttachVolumeTestJSON-275393966 tempest-AttachVolumeTestJSON-275393966-project] 10.222.0.20 "GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a" status: 404 len: 111 microversion: 2.1 time: 0.032038 Aug 12 01:34:26.047102 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 426/848] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:34:26 2022] GET /compute/v2.1/servers/c4364ac0-a9b7-4650-8456-15ccdd39bc3a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:34:26.581463 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-4eaf9b86-fc35-42dc-9168-239f14186b3a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:26.581949 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-4eaf9b86-fc35-42dc-9168-239f14186b3a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 2bb87cca-3f2d-4017-9cb9-1f309cdaacac] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:26.588205 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4eaf9b86-fc35-42dc-9168-239f14186b3a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:26.588709 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4eaf9b86-fc35-42dc-9168-239f14186b3a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:26.589108 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4eaf9b86-fc35-42dc-9168-239f14186b3a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:26.589794 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4eaf9b86-fc35-42dc-9168-239f14186b3a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:26.590234 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4eaf9b86-fc35-42dc-9168-239f14186b3a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:26.590649 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4eaf9b86-fc35-42dc-9168-239f14186b3a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:26.675854 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.objects.instance [None req-4eaf9b86-fc35-42dc-9168-239f14186b3a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lazy-loading 'services' on Instance uuid 2bb87cca-3f2d-4017-9cb9-1f309cdaacac {{(pid=120785) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 01:34:26.739803 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:34:26.753707 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-4eaf9b86-fc35-42dc-9168-239f14186b3a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac/os-volume_attachments/5cae1616-808e-4a4c-a9ae-9a9fbfe4ecf2" status: 202 len: 0 microversion: 2.1 time: 0.176310 Aug 12 01:34:26.754401 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 423/849] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Aug 12 01:34:26 2022] DELETE /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac/os-volume_attachments/5cae1616-808e-4a4c-a9ae-9a9fbfe4ecf2 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 01:34:26.769803 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-dd8db62c-63dc-428c-a9fc-f2b6eb7c04a5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:26.772138 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-dd8db62c-63dc-428c-a9fc-f2b6eb7c04a5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 2bb87cca-3f2d-4017-9cb9-1f309cdaacac] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:26.779171 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dd8db62c-63dc-428c-a9fc-f2b6eb7c04a5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:26.779695 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dd8db62c-63dc-428c-a9fc-f2b6eb7c04a5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:26.780320 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dd8db62c-63dc-428c-a9fc-f2b6eb7c04a5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:26.781031 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dd8db62c-63dc-428c-a9fc-f2b6eb7c04a5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:26.781473 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dd8db62c-63dc-428c-a9fc-f2b6eb7c04a5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:26.781889 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dd8db62c-63dc-428c-a9fc-f2b6eb7c04a5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:26.816936 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-dd8db62c-63dc-428c-a9fc-f2b6eb7c04a5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057713 Aug 12 01:34:26.817502 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 427/850] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 01:34:26 2022] GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 01:34:27.831633 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-0777836c-231e-4ae3-b8ef-487884a9cda5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:27.834927 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-0777836c-231e-4ae3-b8ef-487884a9cda5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 2bb87cca-3f2d-4017-9cb9-1f309cdaacac] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:27.837990 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:34:27.847392 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0777836c-231e-4ae3-b8ef-487884a9cda5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:27.848833 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0777836c-231e-4ae3-b8ef-487884a9cda5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:27.849532 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0777836c-231e-4ae3-b8ef-487884a9cda5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:27.850392 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0777836c-231e-4ae3-b8ef-487884a9cda5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:27.851272 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0777836c-231e-4ae3-b8ef-487884a9cda5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:27.851917 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0777836c-231e-4ae3-b8ef-487884a9cda5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:27.894758 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-0777836c-231e-4ae3-b8ef-487884a9cda5 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068272 Aug 12 01:34:27.895229 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 424/851] 10.222.0.20 () {58 vars in 1302 bytes} [Fri Aug 12 01:34:27 2022] GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 01:34:27.966500 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-04697515-8c78-4ed1-b123-42a42ed98432 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:27.967746 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-04697515-8c78-4ed1-b123-42a42ed98432 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 2bb87cca-3f2d-4017-9cb9-1f309cdaacac] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:27.974706 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-04697515-8c78-4ed1-b123-42a42ed98432 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:27.975273 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-04697515-8c78-4ed1-b123-42a42ed98432 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:27.975797 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-04697515-8c78-4ed1-b123-42a42ed98432 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:27.976583 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-04697515-8c78-4ed1-b123-42a42ed98432 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:27.977089 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-04697515-8c78-4ed1-b123-42a42ed98432 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:27.977766 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-04697515-8c78-4ed1-b123-42a42ed98432 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:28.003972 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-04697515-8c78-4ed1-b123-42a42ed98432 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 2bb87cca-3f2d-4017-9cb9-1f309cdaacac] Going to try to terminate instance {{(pid=120786) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 01:34:28.093854 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-04697515-8c78-4ed1-b123-42a42ed98432 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac" status: 204 len: 0 microversion: 2.1 time: 0.131070 Aug 12 01:34:28.094607 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 428/852] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 01:34:27 2022] DELETE /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 01:34:28.104390 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-cbf8d4ff-b89b-4198-be7e-4eaa0a31e840 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:28.105303 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-cbf8d4ff-b89b-4198-be7e-4eaa0a31e840 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 2bb87cca-3f2d-4017-9cb9-1f309cdaacac] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:28.114330 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cbf8d4ff-b89b-4198-be7e-4eaa0a31e840 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:28.114902 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cbf8d4ff-b89b-4198-be7e-4eaa0a31e840 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:28.115988 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cbf8d4ff-b89b-4198-be7e-4eaa0a31e840 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:28.117258 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cbf8d4ff-b89b-4198-be7e-4eaa0a31e840 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:28.117803 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cbf8d4ff-b89b-4198-be7e-4eaa0a31e840 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:28.118491 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cbf8d4ff-b89b-4198-be7e-4eaa0a31e840 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:28.262273 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-cbf8d4ff-b89b-4198-be7e-4eaa0a31e840 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:28.272699 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-cbf8d4ff-b89b-4198-be7e-4eaa0a31e840 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac" status: 200 len: 1682 microversion: 2.1 time: 0.172943 Aug 12 01:34:28.274082 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 425/853] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:34:28 2022] GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:34:29.295482 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-f49ebbb6-d111-4b67-a1fd-70a979d2a7ee tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:29.296226 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-f49ebbb6-d111-4b67-a1fd-70a979d2a7ee tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 2bb87cca-3f2d-4017-9cb9-1f309cdaacac] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:29.303992 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f49ebbb6-d111-4b67-a1fd-70a979d2a7ee tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:29.304619 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f49ebbb6-d111-4b67-a1fd-70a979d2a7ee tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:29.305040 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f49ebbb6-d111-4b67-a1fd-70a979d2a7ee tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:29.305759 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f49ebbb6-d111-4b67-a1fd-70a979d2a7ee tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:29.306241 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f49ebbb6-d111-4b67-a1fd-70a979d2a7ee tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:29.306644 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f49ebbb6-d111-4b67-a1fd-70a979d2a7ee tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:29.649334 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-f49ebbb6-d111-4b67-a1fd-70a979d2a7ee tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:29.654367 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-f49ebbb6-d111-4b67-a1fd-70a979d2a7ee tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac" status: 200 len: 1682 microversion: 2.1 time: 0.363511 Aug 12 01:34:29.655009 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 429/854] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:34:29 2022] GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac => generated 1682 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:34:30.676304 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-96dedc09-bf5c-4222-9842-4eca49ca6bdf tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:30.677249 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-96dedc09-bf5c-4222-9842-4eca49ca6bdf tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 2bb87cca-3f2d-4017-9cb9-1f309cdaacac] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:30.684983 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-96dedc09-bf5c-4222-9842-4eca49ca6bdf tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:30.685429 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-96dedc09-bf5c-4222-9842-4eca49ca6bdf tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:30.686041 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-96dedc09-bf5c-4222-9842-4eca49ca6bdf tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:30.686971 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-96dedc09-bf5c-4222-9842-4eca49ca6bdf tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:30.687404 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-96dedc09-bf5c-4222-9842-4eca49ca6bdf tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:30.688081 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-96dedc09-bf5c-4222-9842-4eca49ca6bdf tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:30.753461 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-96dedc09-bf5c-4222-9842-4eca49ca6bdf tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4395876e1de944ae82d23d43a30a82a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e2fd72103c4b5e956ef5b9c291f16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:30.762191 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-96dedc09-bf5c-4222-9842-4eca49ca6bdf tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac" status: 200 len: 1615 microversion: 2.1 time: 0.089756 Aug 12 01:34:30.763117 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 426/855] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:34:30 2022] GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac => generated 1615 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:34:30.804894 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-e905ddbe-fbd8-4ef5-8a92-41ebb6962e5c req-2d6fcc9f-bb0a-4020-b597-a58332641f60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bb87cca-3f2d-4017-9cb9-1f309cdaacac", "name": "network-vif-deleted", "tag": "e6870c02-031d-4413-920d-dcc367128484"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:34:30.819015 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-e905ddbe-fbd8-4ef5-8a92-41ebb6962e5c req-2d6fcc9f-bb0a-4020-b597-a58332641f60 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:30.819661 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-e905ddbe-fbd8-4ef5-8a92-41ebb6962e5c req-2d6fcc9f-bb0a-4020-b597-a58332641f60 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:30.820486 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-e905ddbe-fbd8-4ef5-8a92-41ebb6962e5c req-2d6fcc9f-bb0a-4020-b597-a58332641f60 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:30.834393 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-e905ddbe-fbd8-4ef5-8a92-41ebb6962e5c req-2d6fcc9f-bb0a-4020-b597-a58332641f60 service nova] Creating event network-vif-deleted:e6870c02-031d-4413-920d-dcc367128484 for instance 2bb87cca-3f2d-4017-9cb9-1f309cdaacac on hv-cinder-78481 Aug 12 01:34:30.840694 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-e905ddbe-fbd8-4ef5-8a92-41ebb6962e5c req-2d6fcc9f-bb0a-4020-b597-a58332641f60 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044264 Aug 12 01:34:30.841685 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 430/856] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:34:31.785296 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-ee56e8eb-61c8-4c45-ba1b-bcea965c6815 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:31.785968 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-ee56e8eb-61c8-4c45-ba1b-bcea965c6815 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 2bb87cca-3f2d-4017-9cb9-1f309cdaacac] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:31.792481 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ee56e8eb-61c8-4c45-ba1b-bcea965c6815 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:31.792960 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ee56e8eb-61c8-4c45-ba1b-bcea965c6815 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:31.793392 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ee56e8eb-61c8-4c45-ba1b-bcea965c6815 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:31.794094 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ee56e8eb-61c8-4c45-ba1b-bcea965c6815 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:31.794525 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ee56e8eb-61c8-4c45-ba1b-bcea965c6815 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:31.794941 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ee56e8eb-61c8-4c45-ba1b-bcea965c6815 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:31.814576 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.wsgi [None req-ee56e8eb-61c8-4c45-ba1b-bcea965c6815 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] HTTP exception thrown: Instance 2bb87cca-3f2d-4017-9cb9-1f309cdaacac could not be found. Aug 12 01:34:31.816697 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-ee56e8eb-61c8-4c45-ba1b-bcea965c6815 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Request method failure captured: Aug 12 01:34:31.816697 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: request: GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac HTTP/1.1 Aug 12 01:34:31.816697 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept: application/json Aug 12 01:34:31.816697 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept-Encoding: identity Aug 12 01:34:31.816697 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Connection: close Aug 12 01:34:31.816697 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Length: 0 Aug 12 01:34:31.816697 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Type: application/json Aug 12 01:34:31.816697 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Host: 10.222.0.20 Aug 12 01:34:31.816697 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Openstack-System-Scope: None Aug 12 01:34:31.816697 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: User-Agent: python-urllib3/1.26.11 Aug 12 01:34:31.816697 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Auth-Token: gAAAAABi9aysta1ExUaxXxQ9rYnSUQP7esxJrZzjQTGP-Rx-1mSW3FSa4Ni1V3s1gY-bX9pmoxF8Imm85iSgEmyp6i7Om1zZCTrheGnqYhUdvsswrsrCeMS3azlEhIm0ZDa-UZ_XH6zsXrFWA97-e9Lhn4LyTV3IcnRq62-QuKU-oVMmx5EzFRU Aug 12 01:34:31.816697 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Id: None Aug 12 01:34:31.816697 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Name: None Aug 12 01:34:31.816697 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Identity-Status: Confirmed Aug 12 01:34:31.816697 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Is-Admin-Project: True Aug 12 01:34:31.816697 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Id: default Aug 12 01:34:31.816697 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Name: Default Aug 12 01:34:31.816697 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Id: e5e2fd72103c4b5e956ef5b9c291f16d Aug 12 01:34:31.816697 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:34:31.816697 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Role: member,reader Aug 12 01:34:31.816697 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Roles: member,reader Aug 12 01:34:31.818193 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e5e2fd72103c4b5e956ef5b9c291f16d"}]}] Aug 12 01:34:31.818193 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:34:31.818193 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Id: e5e2fd72103c4b5e956ef5b9c291f16d Aug 12 01:34:31.818193 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:34:31.818193 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User: tempest-AttachVolumeNegativeTest-2079581927-project Aug 12 01:34:31.818193 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Id: default Aug 12 01:34:31.818193 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Name: Default Aug 12 01:34:31.818193 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Id: 4395876e1de944ae82d23d43a30a82a8 Aug 12 01:34:31.818193 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Name: tempest-AttachVolumeNegativeTest-2079581927-project Aug 12 01:34:31.818193 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: method: > Aug 12 01:34:31.818193 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: exception: Instance 2bb87cca-3f2d-4017-9cb9-1f309cdaacac could not be found. Aug 12 01:34:31.818193 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: action_args: {'id': '2bb87cca-3f2d-4017-9cb9-1f309cdaacac'} Aug 12 01:34:31.819008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:34:31.819008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:31.819008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:34:31.819008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:34:31.819008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:34:31.819008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:34:31.819008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:34:31.819008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:34:31.819008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:34:31.819008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:34:31.819008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bb87cca-3f2d-4017-9cb9-1f309cdaacac could not be found. Aug 12 01:34:31.819008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:31.819008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:34:31.819008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:31.819008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:31.819008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:34:31.819008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:34:31.819008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:34:31.819008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:34:31.819008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:34:31.820389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:34:31.820389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 01:34:31.820389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 01:34:31.820389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:34:31.820389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:34:31.820389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:34:31.820389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:34:31.820389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bb87cca-3f2d-4017-9cb9-1f309cdaacac could not be found. Aug 12 01:34:31.820389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:31.820389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:34:31.820389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:31.820389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:31.820389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:34:31.820389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:34:31.820389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:34:31.820389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:34:31.820389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bb87cca-3f2d-4017-9cb9-1f309cdaacac could not be found. Aug 12 01:34:31.820389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:31.821766 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-ee56e8eb-61c8-4c45-ba1b-bcea965c6815 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Returning 404 to user: Instance 2bb87cca-3f2d-4017-9cb9-1f309cdaacac could not be found. {{(pid=120785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:34:31.821766 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-ee56e8eb-61c8-4c45-ba1b-bcea965c6815 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac" status: 404 len: 111 microversion: 2.1 time: 0.037144 Aug 12 01:34:31.821766 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 427/857] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:34:31 2022] GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:34:31.828490 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-7e93ac33-3de0-49be-b2b5-c5415298fc6e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '.version_select at 0x7f2decc59700>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:31.854031 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-7e93ac33-3de0-49be-b2b5-c5415298fc6e tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-196972616" status: 202 len: 0 microversion: 2.1 time: 0.030345 Aug 12 01:34:31.854598 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 431/858] 10.222.0.20 () {58 vars in 1218 bytes} [Fri Aug 12 01:34:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-196972616 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 01:34:33.698731 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-39f61120-d99c-407f-9f01-f92de298d2c8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:33.699726 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-39f61120-d99c-407f-9f01-f92de298d2c8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 2bb87cca-3f2d-4017-9cb9-1f309cdaacac] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:33.710433 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-39f61120-d99c-407f-9f01-f92de298d2c8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:33.711165 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-39f61120-d99c-407f-9f01-f92de298d2c8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:33.711923 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-39f61120-d99c-407f-9f01-f92de298d2c8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:33.713108 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-39f61120-d99c-407f-9f01-f92de298d2c8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:33.713552 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-39f61120-d99c-407f-9f01-f92de298d2c8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:33.713965 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-39f61120-d99c-407f-9f01-f92de298d2c8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:33.732650 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.wsgi [None req-39f61120-d99c-407f-9f01-f92de298d2c8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] HTTP exception thrown: Instance 2bb87cca-3f2d-4017-9cb9-1f309cdaacac could not be found. Aug 12 01:34:33.734364 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-39f61120-d99c-407f-9f01-f92de298d2c8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Request method failure captured: Aug 12 01:34:33.734364 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: request: DELETE /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac HTTP/1.1 Aug 12 01:34:33.734364 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept: application/json Aug 12 01:34:33.734364 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept-Encoding: identity Aug 12 01:34:33.734364 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Connection: close Aug 12 01:34:33.734364 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Length: 0 Aug 12 01:34:33.734364 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Type: application/json Aug 12 01:34:33.734364 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Host: 10.222.0.20 Aug 12 01:34:33.734364 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Openstack-System-Scope: None Aug 12 01:34:33.734364 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: User-Agent: python-urllib3/1.26.11 Aug 12 01:34:33.734364 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Auth-Token: gAAAAABi9aysta1ExUaxXxQ9rYnSUQP7esxJrZzjQTGP-Rx-1mSW3FSa4Ni1V3s1gY-bX9pmoxF8Imm85iSgEmyp6i7Om1zZCTrheGnqYhUdvsswrsrCeMS3azlEhIm0ZDa-UZ_XH6zsXrFWA97-e9Lhn4LyTV3IcnRq62-QuKU-oVMmx5EzFRU Aug 12 01:34:33.734364 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Id: None Aug 12 01:34:33.734364 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Name: None Aug 12 01:34:33.734364 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Identity-Status: Confirmed Aug 12 01:34:33.734364 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Is-Admin-Project: True Aug 12 01:34:33.734364 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Id: default Aug 12 01:34:33.734364 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Name: Default Aug 12 01:34:33.734364 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Id: e5e2fd72103c4b5e956ef5b9c291f16d Aug 12 01:34:33.734364 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:34:33.734364 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Role: member,reader Aug 12 01:34:33.734364 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Roles: member,reader Aug 12 01:34:33.736033 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e5e2fd72103c4b5e956ef5b9c291f16d"}]}] Aug 12 01:34:33.736033 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:34:33.736033 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Id: e5e2fd72103c4b5e956ef5b9c291f16d Aug 12 01:34:33.736033 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:34:33.736033 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User: tempest-AttachVolumeNegativeTest-2079581927-project Aug 12 01:34:33.736033 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Id: default Aug 12 01:34:33.736033 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Name: Default Aug 12 01:34:33.736033 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Id: 4395876e1de944ae82d23d43a30a82a8 Aug 12 01:34:33.736033 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Name: tempest-AttachVolumeNegativeTest-2079581927-project Aug 12 01:34:33.736033 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: method: > Aug 12 01:34:33.736033 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: exception: Instance 2bb87cca-3f2d-4017-9cb9-1f309cdaacac could not be found. Aug 12 01:34:33.736033 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: action_args: {'id': '2bb87cca-3f2d-4017-9cb9-1f309cdaacac'} Aug 12 01:34:33.739811 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:34:33.739811 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:33.739811 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:34:33.739811 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:34:33.739811 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:34:33.739811 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:34:33.739811 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:34:33.739811 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:34:33.739811 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:34:33.739811 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:34:33.739811 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bb87cca-3f2d-4017-9cb9-1f309cdaacac could not be found. Aug 12 01:34:33.739811 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:33.739811 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:34:33.739811 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:33.739811 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:33.739811 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:34:33.739811 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:34:33.739811 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:34:33.739811 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:34:33.739811 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:34:33.741173 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:34:33.741173 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 01:34:33.741173 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 01:34:33.741173 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 01:34:33.741173 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 01:34:33.741173 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:34:33.741173 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:34:33.741173 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:34:33.741173 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:34:33.741173 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bb87cca-3f2d-4017-9cb9-1f309cdaacac could not be found. Aug 12 01:34:33.741173 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:33.741173 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:34:33.741173 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:33.741173 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:33.741173 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:34:33.741173 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:34:33.741173 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:34:33.741173 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:34:33.741173 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bb87cca-3f2d-4017-9cb9-1f309cdaacac could not be found. Aug 12 01:34:33.741173 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:33.742603 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-39f61120-d99c-407f-9f01-f92de298d2c8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Returning 404 to user: Instance 2bb87cca-3f2d-4017-9cb9-1f309cdaacac could not be found. {{(pid=120785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:34:33.742603 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-39f61120-d99c-407f-9f01-f92de298d2c8 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac" status: 404 len: 111 microversion: 2.1 time: 0.043650 Aug 12 01:34:33.742603 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 428/859] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 01:34:33 2022] DELETE /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:34:33.744811 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-2142448d-53a7-4b02-9caa-beda597655c1 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:33.745580 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-2142448d-53a7-4b02-9caa-beda597655c1 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 2bb87cca-3f2d-4017-9cb9-1f309cdaacac] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:33.748177 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:34:33.754476 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2142448d-53a7-4b02-9caa-beda597655c1 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:33.754991 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2142448d-53a7-4b02-9caa-beda597655c1 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:33.755451 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2142448d-53a7-4b02-9caa-beda597655c1 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:33.756221 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2142448d-53a7-4b02-9caa-beda597655c1 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:33.756714 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2142448d-53a7-4b02-9caa-beda597655c1 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:33.757133 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2142448d-53a7-4b02-9caa-beda597655c1 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:33.772725 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.wsgi [None req-2142448d-53a7-4b02-9caa-beda597655c1 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] HTTP exception thrown: Instance 2bb87cca-3f2d-4017-9cb9-1f309cdaacac could not be found. Aug 12 01:34:33.774388 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-2142448d-53a7-4b02-9caa-beda597655c1 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Request method failure captured: Aug 12 01:34:33.774388 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: request: GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac HTTP/1.1 Aug 12 01:34:33.774388 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept: application/json Aug 12 01:34:33.774388 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept-Encoding: identity Aug 12 01:34:33.774388 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Connection: close Aug 12 01:34:33.774388 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Length: 0 Aug 12 01:34:33.774388 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Type: application/json Aug 12 01:34:33.774388 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Host: 10.222.0.20 Aug 12 01:34:33.774388 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Openstack-System-Scope: None Aug 12 01:34:33.774388 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: User-Agent: python-urllib3/1.26.11 Aug 12 01:34:33.774388 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Auth-Token: gAAAAABi9aysta1ExUaxXxQ9rYnSUQP7esxJrZzjQTGP-Rx-1mSW3FSa4Ni1V3s1gY-bX9pmoxF8Imm85iSgEmyp6i7Om1zZCTrheGnqYhUdvsswrsrCeMS3azlEhIm0ZDa-UZ_XH6zsXrFWA97-e9Lhn4LyTV3IcnRq62-QuKU-oVMmx5EzFRU Aug 12 01:34:33.774388 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Id: None Aug 12 01:34:33.774388 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Name: None Aug 12 01:34:33.774388 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Identity-Status: Confirmed Aug 12 01:34:33.774388 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Is-Admin-Project: True Aug 12 01:34:33.774388 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Id: default Aug 12 01:34:33.774388 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Name: Default Aug 12 01:34:33.774388 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Id: e5e2fd72103c4b5e956ef5b9c291f16d Aug 12 01:34:33.774388 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:34:33.774388 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Role: member,reader Aug 12 01:34:33.774388 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Roles: member,reader Aug 12 01:34:33.776151 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e5e2fd72103c4b5e956ef5b9c291f16d"}]}] Aug 12 01:34:33.776151 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:34:33.776151 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Id: e5e2fd72103c4b5e956ef5b9c291f16d Aug 12 01:34:33.776151 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:34:33.776151 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User: tempest-AttachVolumeNegativeTest-2079581927-project Aug 12 01:34:33.776151 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Id: default Aug 12 01:34:33.776151 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Name: Default Aug 12 01:34:33.776151 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Id: 4395876e1de944ae82d23d43a30a82a8 Aug 12 01:34:33.776151 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Name: tempest-AttachVolumeNegativeTest-2079581927-project Aug 12 01:34:33.776151 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: method: > Aug 12 01:34:33.776151 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: exception: Instance 2bb87cca-3f2d-4017-9cb9-1f309cdaacac could not be found. Aug 12 01:34:33.776151 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: action_args: {'id': '2bb87cca-3f2d-4017-9cb9-1f309cdaacac'} Aug 12 01:34:33.777118 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:34:33.777118 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:33.777118 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:34:33.777118 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:34:33.777118 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:34:33.777118 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:34:33.777118 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:34:33.777118 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:34:33.777118 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:34:33.777118 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:34:33.777118 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bb87cca-3f2d-4017-9cb9-1f309cdaacac could not be found. Aug 12 01:34:33.777118 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:33.777118 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:34:33.777118 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:33.777118 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:33.777118 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:34:33.777118 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:34:33.777118 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:34:33.777118 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:34:33.777118 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:34:33.780003 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:34:33.780003 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 01:34:33.780003 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 01:34:33.780003 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:34:33.780003 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:34:33.780003 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:34:33.780003 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:34:33.780003 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bb87cca-3f2d-4017-9cb9-1f309cdaacac could not be found. Aug 12 01:34:33.780003 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:33.780003 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:34:33.780003 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:33.780003 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:33.780003 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:34:33.780003 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:34:33.780003 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:34:33.780003 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:34:33.780003 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bb87cca-3f2d-4017-9cb9-1f309cdaacac could not be found. Aug 12 01:34:33.780003 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:33.781789 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-2142448d-53a7-4b02-9caa-beda597655c1 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Returning 404 to user: Instance 2bb87cca-3f2d-4017-9cb9-1f309cdaacac could not be found. {{(pid=120786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:34:33.781789 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-2142448d-53a7-4b02-9caa-beda597655c1 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac" status: 404 len: 111 microversion: 2.1 time: 0.035131 Aug 12 01:34:33.781789 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 432/860] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:34:33 2022] GET /compute/v2.1/servers/2bb87cca-3f2d-4017-9cb9-1f309cdaacac => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:34:34.929455 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-38092f45-27dd-4fa1-ae8f-e5cb2dac0dd9 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:34.929943 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-38092f45-27dd-4fa1-ae8f-e5cb2dac0dd9 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 033d7c0c-b5ff-43bb-995d-500a2c087f7d] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:34.936863 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-38092f45-27dd-4fa1-ae8f-e5cb2dac0dd9 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:34.937424 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-38092f45-27dd-4fa1-ae8f-e5cb2dac0dd9 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:34.937914 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-38092f45-27dd-4fa1-ae8f-e5cb2dac0dd9 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:34.938675 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-38092f45-27dd-4fa1-ae8f-e5cb2dac0dd9 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:34.939183 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-38092f45-27dd-4fa1-ae8f-e5cb2dac0dd9 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:34.939697 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-38092f45-27dd-4fa1-ae8f-e5cb2dac0dd9 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:34.953590 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.wsgi [None req-38092f45-27dd-4fa1-ae8f-e5cb2dac0dd9 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] HTTP exception thrown: Instance 033d7c0c-b5ff-43bb-995d-500a2c087f7d could not be found. Aug 12 01:34:34.955143 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-38092f45-27dd-4fa1-ae8f-e5cb2dac0dd9 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Request method failure captured: Aug 12 01:34:34.955143 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: request: DELETE /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d HTTP/1.1 Aug 12 01:34:34.955143 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept: application/json Aug 12 01:34:34.955143 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept-Encoding: identity Aug 12 01:34:34.955143 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Connection: close Aug 12 01:34:34.955143 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Length: 0 Aug 12 01:34:34.955143 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Type: application/json Aug 12 01:34:34.955143 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Host: 10.222.0.20 Aug 12 01:34:34.955143 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Openstack-System-Scope: None Aug 12 01:34:34.955143 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: User-Agent: python-urllib3/1.26.11 Aug 12 01:34:34.955143 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Auth-Token: gAAAAABi9aysta1ExUaxXxQ9rYnSUQP7esxJrZzjQTGP-Rx-1mSW3FSa4Ni1V3s1gY-bX9pmoxF8Imm85iSgEmyp6i7Om1zZCTrheGnqYhUdvsswrsrCeMS3azlEhIm0ZDa-UZ_XH6zsXrFWA97-e9Lhn4LyTV3IcnRq62-QuKU-oVMmx5EzFRU Aug 12 01:34:34.955143 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Id: None Aug 12 01:34:34.955143 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Name: None Aug 12 01:34:34.955143 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Identity-Status: Confirmed Aug 12 01:34:34.955143 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Is-Admin-Project: True Aug 12 01:34:34.955143 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Id: default Aug 12 01:34:34.955143 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Name: Default Aug 12 01:34:34.955143 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Id: e5e2fd72103c4b5e956ef5b9c291f16d Aug 12 01:34:34.955143 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:34:34.955143 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Role: member,reader Aug 12 01:34:34.955143 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Roles: member,reader Aug 12 01:34:34.956664 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e5e2fd72103c4b5e956ef5b9c291f16d"}]}] Aug 12 01:34:34.956664 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:34:34.956664 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Id: e5e2fd72103c4b5e956ef5b9c291f16d Aug 12 01:34:34.956664 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:34:34.956664 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User: tempest-AttachVolumeNegativeTest-2079581927-project Aug 12 01:34:34.956664 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Id: default Aug 12 01:34:34.956664 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Name: Default Aug 12 01:34:34.956664 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Id: 4395876e1de944ae82d23d43a30a82a8 Aug 12 01:34:34.956664 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Name: tempest-AttachVolumeNegativeTest-2079581927-project Aug 12 01:34:34.956664 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: method: > Aug 12 01:34:34.956664 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: exception: Instance 033d7c0c-b5ff-43bb-995d-500a2c087f7d could not be found. Aug 12 01:34:34.956664 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: action_args: {'id': '033d7c0c-b5ff-43bb-995d-500a2c087f7d'} Aug 12 01:34:34.957578 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:34:34.957578 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:34.957578 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:34:34.957578 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:34:34.957578 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:34:34.957578 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:34:34.957578 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:34:34.957578 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:34:34.957578 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:34:34.957578 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:34:34.957578 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 033d7c0c-b5ff-43bb-995d-500a2c087f7d could not be found. Aug 12 01:34:34.957578 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:34.957578 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:34:34.957578 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:34.957578 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:34.957578 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:34:34.957578 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:34:34.957578 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:34:34.957578 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:34:34.957578 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:34:34.958856 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:34:34.958856 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 01:34:34.958856 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 01:34:34.958856 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 01:34:34.958856 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 01:34:34.958856 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:34:34.958856 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:34:34.958856 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:34:34.958856 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:34:34.958856 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 033d7c0c-b5ff-43bb-995d-500a2c087f7d could not be found. Aug 12 01:34:34.958856 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:34.958856 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:34:34.958856 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:34.958856 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:34.958856 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:34:34.958856 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:34:34.958856 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:34:34.958856 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:34:34.958856 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 033d7c0c-b5ff-43bb-995d-500a2c087f7d could not be found. Aug 12 01:34:34.958856 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:34.960282 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-38092f45-27dd-4fa1-ae8f-e5cb2dac0dd9 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Returning 404 to user: Instance 033d7c0c-b5ff-43bb-995d-500a2c087f7d could not be found. {{(pid=120785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:34:34.960282 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-38092f45-27dd-4fa1-ae8f-e5cb2dac0dd9 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "DELETE /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d" status: 404 len: 111 microversion: 2.1 time: 0.031380 Aug 12 01:34:34.960282 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 429/861] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 01:34:34 2022] DELETE /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:34:34.965177 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-5d3bf84a-86ae-458f-ac81-22c2246b3b8a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:34.965808 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-5d3bf84a-86ae-458f-ac81-22c2246b3b8a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 033d7c0c-b5ff-43bb-995d-500a2c087f7d] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:34.972614 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5d3bf84a-86ae-458f-ac81-22c2246b3b8a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:34.973091 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5d3bf84a-86ae-458f-ac81-22c2246b3b8a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:34.973521 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5d3bf84a-86ae-458f-ac81-22c2246b3b8a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:34.974206 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5d3bf84a-86ae-458f-ac81-22c2246b3b8a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:34.974684 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5d3bf84a-86ae-458f-ac81-22c2246b3b8a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:34.975103 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5d3bf84a-86ae-458f-ac81-22c2246b3b8a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:34.988808 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.wsgi [None req-5d3bf84a-86ae-458f-ac81-22c2246b3b8a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] HTTP exception thrown: Instance 033d7c0c-b5ff-43bb-995d-500a2c087f7d could not be found. Aug 12 01:34:34.990323 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-5d3bf84a-86ae-458f-ac81-22c2246b3b8a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Request method failure captured: Aug 12 01:34:34.990323 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: request: GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d HTTP/1.1 Aug 12 01:34:34.990323 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept: application/json Aug 12 01:34:34.990323 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept-Encoding: identity Aug 12 01:34:34.990323 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Connection: close Aug 12 01:34:34.990323 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Length: 0 Aug 12 01:34:34.990323 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Type: application/json Aug 12 01:34:34.990323 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Host: 10.222.0.20 Aug 12 01:34:34.990323 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Openstack-System-Scope: None Aug 12 01:34:34.990323 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: User-Agent: python-urllib3/1.26.11 Aug 12 01:34:34.990323 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Auth-Token: gAAAAABi9aysta1ExUaxXxQ9rYnSUQP7esxJrZzjQTGP-Rx-1mSW3FSa4Ni1V3s1gY-bX9pmoxF8Imm85iSgEmyp6i7Om1zZCTrheGnqYhUdvsswrsrCeMS3azlEhIm0ZDa-UZ_XH6zsXrFWA97-e9Lhn4LyTV3IcnRq62-QuKU-oVMmx5EzFRU Aug 12 01:34:34.990323 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Id: None Aug 12 01:34:34.990323 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Name: None Aug 12 01:34:34.990323 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Identity-Status: Confirmed Aug 12 01:34:34.990323 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Is-Admin-Project: True Aug 12 01:34:34.990323 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Id: default Aug 12 01:34:34.990323 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Name: Default Aug 12 01:34:34.990323 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Id: e5e2fd72103c4b5e956ef5b9c291f16d Aug 12 01:34:34.990323 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:34:34.990323 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Role: member,reader Aug 12 01:34:34.990323 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Roles: member,reader Aug 12 01:34:34.991869 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e5e2fd72103c4b5e956ef5b9c291f16d"}]}] Aug 12 01:34:34.991869 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:34:34.991869 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Id: e5e2fd72103c4b5e956ef5b9c291f16d Aug 12 01:34:34.991869 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:34:34.991869 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User: tempest-AttachVolumeNegativeTest-2079581927-project Aug 12 01:34:34.991869 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Id: default Aug 12 01:34:34.991869 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Name: Default Aug 12 01:34:34.991869 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Id: 4395876e1de944ae82d23d43a30a82a8 Aug 12 01:34:34.991869 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Name: tempest-AttachVolumeNegativeTest-2079581927-project Aug 12 01:34:34.991869 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: method: > Aug 12 01:34:34.991869 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: exception: Instance 033d7c0c-b5ff-43bb-995d-500a2c087f7d could not be found. Aug 12 01:34:34.991869 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: action_args: {'id': '033d7c0c-b5ff-43bb-995d-500a2c087f7d'} Aug 12 01:34:34.992882 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:34:34.992882 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:34.992882 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:34:34.992882 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:34:34.992882 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:34:34.992882 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:34:34.992882 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:34:34.992882 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:34:34.992882 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:34:34.992882 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:34:34.992882 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 033d7c0c-b5ff-43bb-995d-500a2c087f7d could not be found. Aug 12 01:34:34.992882 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:34.992882 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:34:34.992882 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:34.992882 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:34.992882 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:34:34.992882 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:34:34.992882 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:34:34.992882 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:34:34.992882 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:34:34.994527 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:34:34.994527 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 01:34:34.994527 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 01:34:34.994527 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:34:34.994527 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:34:34.994527 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:34:34.994527 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:34:34.994527 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 033d7c0c-b5ff-43bb-995d-500a2c087f7d could not be found. Aug 12 01:34:34.994527 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:34.994527 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:34:34.994527 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:34.994527 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:34.994527 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:34:34.994527 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:34:34.994527 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:34:34.994527 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:34:34.994527 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 033d7c0c-b5ff-43bb-995d-500a2c087f7d could not be found. Aug 12 01:34:34.994527 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:34.995874 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-5d3bf84a-86ae-458f-ac81-22c2246b3b8a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Returning 404 to user: Instance 033d7c0c-b5ff-43bb-995d-500a2c087f7d could not be found. {{(pid=120786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:34:34.995874 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-5d3bf84a-86ae-458f-ac81-22c2246b3b8a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d" status: 404 len: 111 microversion: 2.1 time: 0.030449 Aug 12 01:34:34.995874 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 433/862] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:34:34 2022] GET /compute/v2.1/servers/033d7c0c-b5ff-43bb-995d-500a2c087f7d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:34:35.000209 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-432505de-6a5b-45de-abe9-90440a6ff682 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:35.000700 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-432505de-6a5b-45de-abe9-90440a6ff682 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 0835a143-9929-4018-99dc-2f3e3915fb43] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:35.006926 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-432505de-6a5b-45de-abe9-90440a6ff682 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:35.007400 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-432505de-6a5b-45de-abe9-90440a6ff682 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:35.007850 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-432505de-6a5b-45de-abe9-90440a6ff682 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:35.008526 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-432505de-6a5b-45de-abe9-90440a6ff682 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:35.008968 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-432505de-6a5b-45de-abe9-90440a6ff682 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:35.009520 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-432505de-6a5b-45de-abe9-90440a6ff682 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:35.022934 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.wsgi [None req-432505de-6a5b-45de-abe9-90440a6ff682 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] HTTP exception thrown: Instance 0835a143-9929-4018-99dc-2f3e3915fb43 could not be found. Aug 12 01:34:35.024502 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-432505de-6a5b-45de-abe9-90440a6ff682 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Request method failure captured: Aug 12 01:34:35.024502 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: request: DELETE /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43 HTTP/1.1 Aug 12 01:34:35.024502 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept: application/json Aug 12 01:34:35.024502 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept-Encoding: identity Aug 12 01:34:35.024502 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Connection: close Aug 12 01:34:35.024502 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Length: 0 Aug 12 01:34:35.024502 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Type: application/json Aug 12 01:34:35.024502 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Host: 10.222.0.20 Aug 12 01:34:35.024502 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Openstack-System-Scope: None Aug 12 01:34:35.024502 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: User-Agent: python-urllib3/1.26.11 Aug 12 01:34:35.024502 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Auth-Token: gAAAAABi9aysta1ExUaxXxQ9rYnSUQP7esxJrZzjQTGP-Rx-1mSW3FSa4Ni1V3s1gY-bX9pmoxF8Imm85iSgEmyp6i7Om1zZCTrheGnqYhUdvsswrsrCeMS3azlEhIm0ZDa-UZ_XH6zsXrFWA97-e9Lhn4LyTV3IcnRq62-QuKU-oVMmx5EzFRU Aug 12 01:34:35.024502 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Id: None Aug 12 01:34:35.024502 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Name: None Aug 12 01:34:35.024502 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Identity-Status: Confirmed Aug 12 01:34:35.024502 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Is-Admin-Project: True Aug 12 01:34:35.024502 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Id: default Aug 12 01:34:35.024502 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Name: Default Aug 12 01:34:35.024502 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Id: e5e2fd72103c4b5e956ef5b9c291f16d Aug 12 01:34:35.024502 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:34:35.024502 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Role: member,reader Aug 12 01:34:35.024502 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Roles: member,reader Aug 12 01:34:35.026115 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e5e2fd72103c4b5e956ef5b9c291f16d"}]}] Aug 12 01:34:35.026115 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:34:35.026115 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Id: e5e2fd72103c4b5e956ef5b9c291f16d Aug 12 01:34:35.026115 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:34:35.026115 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User: tempest-AttachVolumeNegativeTest-2079581927-project Aug 12 01:34:35.026115 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Id: default Aug 12 01:34:35.026115 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Name: Default Aug 12 01:34:35.026115 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Id: 4395876e1de944ae82d23d43a30a82a8 Aug 12 01:34:35.026115 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Name: tempest-AttachVolumeNegativeTest-2079581927-project Aug 12 01:34:35.026115 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: method: > Aug 12 01:34:35.026115 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: exception: Instance 0835a143-9929-4018-99dc-2f3e3915fb43 could not be found. Aug 12 01:34:35.026115 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: action_args: {'id': '0835a143-9929-4018-99dc-2f3e3915fb43'} Aug 12 01:34:35.029815 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:34:35.029815 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:35.029815 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:34:35.029815 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:34:35.029815 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:34:35.029815 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:34:35.029815 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:34:35.029815 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:34:35.029815 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:34:35.029815 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:34:35.029815 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0835a143-9929-4018-99dc-2f3e3915fb43 could not be found. Aug 12 01:34:35.029815 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:35.029815 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:34:35.029815 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:35.029815 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:35.029815 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:34:35.029815 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:34:35.029815 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:34:35.029815 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:34:35.029815 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:34:35.031248 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:34:35.031248 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 01:34:35.031248 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 01:34:35.031248 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 01:34:35.031248 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 01:34:35.031248 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:34:35.031248 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:34:35.031248 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:34:35.031248 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:34:35.031248 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0835a143-9929-4018-99dc-2f3e3915fb43 could not be found. Aug 12 01:34:35.031248 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:35.031248 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:34:35.031248 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:35.031248 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:35.031248 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:34:35.031248 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:34:35.031248 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:34:35.031248 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:34:35.031248 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0835a143-9929-4018-99dc-2f3e3915fb43 could not be found. Aug 12 01:34:35.031248 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:35.032766 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-432505de-6a5b-45de-abe9-90440a6ff682 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Returning 404 to user: Instance 0835a143-9929-4018-99dc-2f3e3915fb43 could not be found. {{(pid=120785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:34:35.032766 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-432505de-6a5b-45de-abe9-90440a6ff682 tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43" status: 404 len: 111 microversion: 2.1 time: 0.029459 Aug 12 01:34:35.032766 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 430/863] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 01:34:34 2022] DELETE /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:34:35.034520 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-ad9c8adb-5f22-4e2c-8130-1d186e1d905c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:35.035124 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-ad9c8adb-5f22-4e2c-8130-1d186e1d905c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: 0835a143-9929-4018-99dc-2f3e3915fb43] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:35.041463 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ad9c8adb-5f22-4e2c-8130-1d186e1d905c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:35.041934 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ad9c8adb-5f22-4e2c-8130-1d186e1d905c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:35.042359 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ad9c8adb-5f22-4e2c-8130-1d186e1d905c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:35.043043 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ad9c8adb-5f22-4e2c-8130-1d186e1d905c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:35.043483 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ad9c8adb-5f22-4e2c-8130-1d186e1d905c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:35.043953 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ad9c8adb-5f22-4e2c-8130-1d186e1d905c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:35.058417 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.wsgi [None req-ad9c8adb-5f22-4e2c-8130-1d186e1d905c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] HTTP exception thrown: Instance 0835a143-9929-4018-99dc-2f3e3915fb43 could not be found. Aug 12 01:34:35.060007 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-ad9c8adb-5f22-4e2c-8130-1d186e1d905c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Request method failure captured: Aug 12 01:34:35.060007 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: request: GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43 HTTP/1.1 Aug 12 01:34:35.060007 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept: application/json Aug 12 01:34:35.060007 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept-Encoding: identity Aug 12 01:34:35.060007 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Connection: close Aug 12 01:34:35.060007 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Length: 0 Aug 12 01:34:35.060007 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Type: application/json Aug 12 01:34:35.060007 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Host: 10.222.0.20 Aug 12 01:34:35.060007 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Openstack-System-Scope: None Aug 12 01:34:35.060007 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: User-Agent: python-urllib3/1.26.11 Aug 12 01:34:35.060007 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Auth-Token: gAAAAABi9aysta1ExUaxXxQ9rYnSUQP7esxJrZzjQTGP-Rx-1mSW3FSa4Ni1V3s1gY-bX9pmoxF8Imm85iSgEmyp6i7Om1zZCTrheGnqYhUdvsswrsrCeMS3azlEhIm0ZDa-UZ_XH6zsXrFWA97-e9Lhn4LyTV3IcnRq62-QuKU-oVMmx5EzFRU Aug 12 01:34:35.060007 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Id: None Aug 12 01:34:35.060007 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Name: None Aug 12 01:34:35.060007 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Identity-Status: Confirmed Aug 12 01:34:35.060007 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Is-Admin-Project: True Aug 12 01:34:35.060007 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Id: default Aug 12 01:34:35.060007 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Name: Default Aug 12 01:34:35.060007 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Id: e5e2fd72103c4b5e956ef5b9c291f16d Aug 12 01:34:35.060007 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:34:35.060007 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Role: member,reader Aug 12 01:34:35.060007 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Roles: member,reader Aug 12 01:34:35.061505 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e5e2fd72103c4b5e956ef5b9c291f16d"}]}] Aug 12 01:34:35.061505 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:34:35.061505 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Id: e5e2fd72103c4b5e956ef5b9c291f16d Aug 12 01:34:35.061505 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:34:35.061505 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User: tempest-AttachVolumeNegativeTest-2079581927-project Aug 12 01:34:35.061505 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Id: default Aug 12 01:34:35.061505 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Name: Default Aug 12 01:34:35.061505 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Id: 4395876e1de944ae82d23d43a30a82a8 Aug 12 01:34:35.061505 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Name: tempest-AttachVolumeNegativeTest-2079581927-project Aug 12 01:34:35.061505 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: method: > Aug 12 01:34:35.061505 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: exception: Instance 0835a143-9929-4018-99dc-2f3e3915fb43 could not be found. Aug 12 01:34:35.061505 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: action_args: {'id': '0835a143-9929-4018-99dc-2f3e3915fb43'} Aug 12 01:34:35.065431 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:34:35.065431 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:35.065431 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:34:35.065431 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:34:35.065431 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:34:35.065431 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:34:35.065431 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:34:35.065431 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:34:35.065431 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:34:35.065431 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:34:35.065431 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0835a143-9929-4018-99dc-2f3e3915fb43 could not be found. Aug 12 01:34:35.065431 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:35.065431 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:34:35.065431 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:35.065431 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:35.065431 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:34:35.065431 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:34:35.065431 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:34:35.065431 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:34:35.065431 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:34:35.066892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:34:35.066892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 01:34:35.066892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 01:34:35.066892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:34:35.066892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:34:35.066892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:34:35.066892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:34:35.066892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0835a143-9929-4018-99dc-2f3e3915fb43 could not be found. Aug 12 01:34:35.066892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:35.066892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:34:35.066892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:35.066892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:35.066892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:34:35.066892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:34:35.066892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:34:35.066892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:34:35.066892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0835a143-9929-4018-99dc-2f3e3915fb43 could not be found. Aug 12 01:34:35.066892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:35.068406 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-ad9c8adb-5f22-4e2c-8130-1d186e1d905c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Returning 404 to user: Instance 0835a143-9929-4018-99dc-2f3e3915fb43 could not be found. {{(pid=120786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:34:35.068406 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-ad9c8adb-5f22-4e2c-8130-1d186e1d905c tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43" status: 404 len: 111 microversion: 2.1 time: 0.030740 Aug 12 01:34:35.068406 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 434/864] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:34:35 2022] GET /compute/v2.1/servers/0835a143-9929-4018-99dc-2f3e3915fb43 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:34:40.430389 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-eac1666e-b417-4ac6-af19-fc09e346607a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:40.430999 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-eac1666e-b417-4ac6-af19-fc09e346607a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:40.437764 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-eac1666e-b417-4ac6-af19-fc09e346607a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:40.438236 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-eac1666e-b417-4ac6-af19-fc09e346607a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:40.438687 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-eac1666e-b417-4ac6-af19-fc09e346607a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:40.439363 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-eac1666e-b417-4ac6-af19-fc09e346607a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:40.439830 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-eac1666e-b417-4ac6-af19-fc09e346607a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:40.440241 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-eac1666e-b417-4ac6-af19-fc09e346607a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:40.453935 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.wsgi [None req-eac1666e-b417-4ac6-af19-fc09e346607a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] HTTP exception thrown: Instance da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 could not be found. Aug 12 01:34:40.455438 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-eac1666e-b417-4ac6-af19-fc09e346607a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Request method failure captured: Aug 12 01:34:40.455438 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: request: DELETE /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 HTTP/1.1 Aug 12 01:34:40.455438 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept: application/json Aug 12 01:34:40.455438 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept-Encoding: identity Aug 12 01:34:40.455438 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Connection: close Aug 12 01:34:40.455438 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Length: 0 Aug 12 01:34:40.455438 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Type: application/json Aug 12 01:34:40.455438 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Host: 10.222.0.20 Aug 12 01:34:40.455438 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Openstack-System-Scope: None Aug 12 01:34:40.455438 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: User-Agent: python-urllib3/1.26.11 Aug 12 01:34:40.455438 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Auth-Token: gAAAAABi9aysta1ExUaxXxQ9rYnSUQP7esxJrZzjQTGP-Rx-1mSW3FSa4Ni1V3s1gY-bX9pmoxF8Imm85iSgEmyp6i7Om1zZCTrheGnqYhUdvsswrsrCeMS3azlEhIm0ZDa-UZ_XH6zsXrFWA97-e9Lhn4LyTV3IcnRq62-QuKU-oVMmx5EzFRU Aug 12 01:34:40.455438 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Id: None Aug 12 01:34:40.455438 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Name: None Aug 12 01:34:40.455438 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Identity-Status: Confirmed Aug 12 01:34:40.455438 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Is-Admin-Project: True Aug 12 01:34:40.455438 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Id: default Aug 12 01:34:40.455438 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Name: Default Aug 12 01:34:40.455438 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Id: e5e2fd72103c4b5e956ef5b9c291f16d Aug 12 01:34:40.455438 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:34:40.455438 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Role: member,reader Aug 12 01:34:40.455438 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Roles: member,reader Aug 12 01:34:40.457039 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e5e2fd72103c4b5e956ef5b9c291f16d"}]}] Aug 12 01:34:40.457039 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:34:40.457039 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Id: e5e2fd72103c4b5e956ef5b9c291f16d Aug 12 01:34:40.457039 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:34:40.457039 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User: tempest-AttachVolumeNegativeTest-2079581927-project Aug 12 01:34:40.457039 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Id: default Aug 12 01:34:40.457039 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Name: Default Aug 12 01:34:40.457039 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Id: 4395876e1de944ae82d23d43a30a82a8 Aug 12 01:34:40.457039 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Name: tempest-AttachVolumeNegativeTest-2079581927-project Aug 12 01:34:40.457039 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: method: > Aug 12 01:34:40.457039 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: exception: Instance da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 could not be found. Aug 12 01:34:40.457039 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: action_args: {'id': 'da106e4a-1bc6-4e68-ac0c-1a2ca899daa9'} Aug 12 01:34:40.457926 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:34:40.457926 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:40.457926 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:34:40.457926 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:34:40.457926 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:34:40.457926 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:34:40.457926 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:34:40.457926 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:34:40.457926 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:34:40.457926 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:34:40.457926 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 could not be found. Aug 12 01:34:40.457926 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:40.457926 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:34:40.457926 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:40.457926 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:40.457926 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:34:40.457926 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:34:40.457926 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:34:40.457926 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:34:40.457926 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:34:40.459421 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:34:40.459421 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 01:34:40.459421 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 01:34:40.459421 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 01:34:40.459421 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 01:34:40.459421 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:34:40.459421 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:34:40.459421 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:34:40.459421 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:34:40.459421 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 could not be found. Aug 12 01:34:40.459421 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:40.459421 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:34:40.459421 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:40.459421 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:40.459421 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:34:40.459421 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:34:40.459421 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:34:40.459421 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:34:40.459421 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 could not be found. Aug 12 01:34:40.459421 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:40.461067 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-eac1666e-b417-4ac6-af19-fc09e346607a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Returning 404 to user: Instance da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 could not be found. {{(pid=120785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:34:40.461067 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-eac1666e-b417-4ac6-af19-fc09e346607a tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "DELETE /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9" status: 404 len: 111 microversion: 2.1 time: 0.030726 Aug 12 01:34:40.461067 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 431/865] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 01:34:40 2022] DELETE /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:34:40.465673 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-92a69949-241d-4fd1-ab62-c0994308708f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:40.466304 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-92a69949-241d-4fd1-ab62-c0994308708f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] [instance: da106e4a-1bc6-4e68-ac0c-1a2ca899daa9] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:40.473249 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-92a69949-241d-4fd1-ab62-c0994308708f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:40.473734 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-92a69949-241d-4fd1-ab62-c0994308708f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:40.474175 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-92a69949-241d-4fd1-ab62-c0994308708f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:40.474871 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-92a69949-241d-4fd1-ab62-c0994308708f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:40.475324 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-92a69949-241d-4fd1-ab62-c0994308708f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:40.475798 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-92a69949-241d-4fd1-ab62-c0994308708f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:40.489192 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.wsgi [None req-92a69949-241d-4fd1-ab62-c0994308708f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] HTTP exception thrown: Instance da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 could not be found. Aug 12 01:34:40.490709 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-92a69949-241d-4fd1-ab62-c0994308708f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Request method failure captured: Aug 12 01:34:40.490709 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: request: GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 HTTP/1.1 Aug 12 01:34:40.490709 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept: application/json Aug 12 01:34:40.490709 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept-Encoding: identity Aug 12 01:34:40.490709 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Connection: close Aug 12 01:34:40.490709 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Length: 0 Aug 12 01:34:40.490709 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Type: application/json Aug 12 01:34:40.490709 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Host: 10.222.0.20 Aug 12 01:34:40.490709 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Openstack-System-Scope: None Aug 12 01:34:40.490709 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: User-Agent: python-urllib3/1.26.11 Aug 12 01:34:40.490709 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Auth-Token: gAAAAABi9aysta1ExUaxXxQ9rYnSUQP7esxJrZzjQTGP-Rx-1mSW3FSa4Ni1V3s1gY-bX9pmoxF8Imm85iSgEmyp6i7Om1zZCTrheGnqYhUdvsswrsrCeMS3azlEhIm0ZDa-UZ_XH6zsXrFWA97-e9Lhn4LyTV3IcnRq62-QuKU-oVMmx5EzFRU Aug 12 01:34:40.490709 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Id: None Aug 12 01:34:40.490709 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Name: None Aug 12 01:34:40.490709 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Identity-Status: Confirmed Aug 12 01:34:40.490709 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Is-Admin-Project: True Aug 12 01:34:40.490709 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Id: default Aug 12 01:34:40.490709 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Name: Default Aug 12 01:34:40.490709 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Id: e5e2fd72103c4b5e956ef5b9c291f16d Aug 12 01:34:40.490709 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:34:40.490709 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Role: member,reader Aug 12 01:34:40.490709 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Roles: member,reader Aug 12 01:34:40.492344 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e5e2fd72103c4b5e956ef5b9c291f16d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e5e2fd72103c4b5e956ef5b9c291f16d"}]}] Aug 12 01:34:40.492344 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:34:40.492344 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Id: e5e2fd72103c4b5e956ef5b9c291f16d Aug 12 01:34:40.492344 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079581927 Aug 12 01:34:40.492344 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User: tempest-AttachVolumeNegativeTest-2079581927-project Aug 12 01:34:40.492344 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Id: default Aug 12 01:34:40.492344 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Name: Default Aug 12 01:34:40.492344 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Id: 4395876e1de944ae82d23d43a30a82a8 Aug 12 01:34:40.492344 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Name: tempest-AttachVolumeNegativeTest-2079581927-project Aug 12 01:34:40.492344 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: method: > Aug 12 01:34:40.492344 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: exception: Instance da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 could not be found. Aug 12 01:34:40.492344 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: action_args: {'id': 'da106e4a-1bc6-4e68-ac0c-1a2ca899daa9'} Aug 12 01:34:40.493222 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:34:40.493222 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:40.493222 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:34:40.493222 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:34:40.493222 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:34:40.493222 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:34:40.493222 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:34:40.493222 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:34:40.493222 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:34:40.493222 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:34:40.493222 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 could not be found. Aug 12 01:34:40.493222 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:40.493222 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:34:40.493222 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:40.493222 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:40.493222 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:34:40.493222 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:34:40.493222 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:34:40.493222 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:34:40.493222 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:34:40.494680 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:34:40.494680 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 01:34:40.494680 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 01:34:40.494680 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:34:40.494680 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:34:40.494680 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:34:40.494680 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:34:40.494680 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 could not be found. Aug 12 01:34:40.494680 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:40.494680 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:34:40.494680 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:40.494680 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:40.494680 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:34:40.494680 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:34:40.494680 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:34:40.494680 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:34:40.494680 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 could not be found. Aug 12 01:34:40.494680 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:40.496052 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-92a69949-241d-4fd1-ab62-c0994308708f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] Returning 404 to user: Instance da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 could not be found. {{(pid=120786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:34:40.496052 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-92a69949-241d-4fd1-ab62-c0994308708f tempest-AttachVolumeNegativeTest-2079581927 tempest-AttachVolumeNegativeTest-2079581927-project] 10.222.0.20 "GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9" status: 404 len: 111 microversion: 2.1 time: 0.030504 Aug 12 01:34:40.496052 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 435/866] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:34:40 2022] GET /compute/v2.1/servers/da106e4a-1bc6-4e68-ac0c-1a2ca899daa9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 12 01:34:48.914553 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-036e073a-c5ec-4ea5-889d-af17af47164b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:48.917029 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-036e073a-c5ec-4ea5-889d-af17af47164b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:48.923775 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-036e073a-c5ec-4ea5-889d-af17af47164b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:48.924821 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-036e073a-c5ec-4ea5-889d-af17af47164b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:48.925260 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-036e073a-c5ec-4ea5-889d-af17af47164b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:48.925943 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-036e073a-c5ec-4ea5-889d-af17af47164b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:48.926382 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-036e073a-c5ec-4ea5-889d-af17af47164b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:48.927106 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-036e073a-c5ec-4ea5-889d-af17af47164b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:48.955253 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-036e073a-c5ec-4ea5-889d-af17af47164b tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044585 Aug 12 01:34:48.956085 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 432/867] 10.222.0.20 () {60 vars in 1343 bytes} [Fri Aug 12 01:34:48 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:34:49.016128 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-6fed96a6-7619-464e-b52f-cf6f354ca1b7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:49.016783 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-6fed96a6-7619-464e-b52f-cf6f354ca1b7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:49.024110 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6fed96a6-7619-464e-b52f-cf6f354ca1b7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:49.024603 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6fed96a6-7619-464e-b52f-cf6f354ca1b7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:49.025033 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6fed96a6-7619-464e-b52f-cf6f354ca1b7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:49.025732 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6fed96a6-7619-464e-b52f-cf6f354ca1b7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:49.026211 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6fed96a6-7619-464e-b52f-cf6f354ca1b7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:49.026581 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6fed96a6-7619-464e-b52f-cf6f354ca1b7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:49.030554 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:34:49.056396 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-6fed96a6-7619-464e-b52f-cf6f354ca1b7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Going to try to terminate instance {{(pid=120786) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 01:34:49.134644 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-6fed96a6-7619-464e-b52f-cf6f354ca1b7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 204 len: 0 microversion: 2.20 time: 0.122444 Aug 12 01:34:49.135113 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 436/868] 10.222.0.20 () {60 vars in 1280 bytes} [Fri Aug 12 01:34:49 2022] DELETE /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 12 01:34:49.144118 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-b524d1a2-04c5-4441-858d-1c90455d0a35 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:49.144724 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-b524d1a2-04c5-4441-858d-1c90455d0a35 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:49.150608 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b524d1a2-04c5-4441-858d-1c90455d0a35 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:49.151060 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b524d1a2-04c5-4441-858d-1c90455d0a35 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:49.151482 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b524d1a2-04c5-4441-858d-1c90455d0a35 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:49.152211 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b524d1a2-04c5-4441-858d-1c90455d0a35 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:49.152650 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b524d1a2-04c5-4441-858d-1c90455d0a35 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:49.153057 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b524d1a2-04c5-4441-858d-1c90455d0a35 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:49.282211 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-b524d1a2-04c5-4441-858d-1c90455d0a35 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:49.290583 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-b524d1a2-04c5-4441-858d-1c90455d0a35 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:49.292168 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-b524d1a2-04c5-4441-858d-1c90455d0a35 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:49.293444 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-b524d1a2-04c5-4441-858d-1c90455d0a35 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1724 microversion: 2.20 time: 0.153559 Aug 12 01:34:49.294018 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 433/869] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:34:49 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:34:50.317320 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-eb11c8b4-de48-424e-8ace-8c2982333117 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:50.318015 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-eb11c8b4-de48-424e-8ace-8c2982333117 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:50.324781 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-eb11c8b4-de48-424e-8ace-8c2982333117 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:50.325261 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-eb11c8b4-de48-424e-8ace-8c2982333117 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:50.325691 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-eb11c8b4-de48-424e-8ace-8c2982333117 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:50.326387 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-eb11c8b4-de48-424e-8ace-8c2982333117 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:50.326828 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-eb11c8b4-de48-424e-8ace-8c2982333117 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:50.327339 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-eb11c8b4-de48-424e-8ace-8c2982333117 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:50.459059 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-eb11c8b4-de48-424e-8ace-8c2982333117 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:50.467488 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-eb11c8b4-de48-424e-8ace-8c2982333117 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:50.469061 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-eb11c8b4-de48-424e-8ace-8c2982333117 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:50.470262 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-eb11c8b4-de48-424e-8ace-8c2982333117 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1724 microversion: 2.20 time: 0.157305 Aug 12 01:34:50.470817 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 437/870] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:34:50 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:34:51.296933 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-9c2545bb-9ce1-4644-8f89-65287b1456ac req-01115f6b-230e-4864-a14f-90d17c015464 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3d50f7a-89e5-4250-be37-7fdf4f9b79da", "name": "network-vif-deleted", "tag": "a7da4e13-3cc9-4eeb-9f82-064424d0880e"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:34:51.308541 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-9c2545bb-9ce1-4644-8f89-65287b1456ac req-01115f6b-230e-4864-a14f-90d17c015464 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:51.309275 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-9c2545bb-9ce1-4644-8f89-65287b1456ac req-01115f6b-230e-4864-a14f-90d17c015464 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:51.309714 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-9c2545bb-9ce1-4644-8f89-65287b1456ac req-01115f6b-230e-4864-a14f-90d17c015464 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:51.322518 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-9c2545bb-9ce1-4644-8f89-65287b1456ac req-01115f6b-230e-4864-a14f-90d17c015464 service nova] Creating event network-vif-deleted:a7da4e13-3cc9-4eeb-9f82-064424d0880e for instance f3d50f7a-89e5-4250-be37-7fdf4f9b79da on hv-cinder-78481 Aug 12 01:34:51.329555 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-9c2545bb-9ce1-4644-8f89-65287b1456ac req-01115f6b-230e-4864-a14f-90d17c015464 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036578 Aug 12 01:34:51.330790 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 434/871] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 01:34:51.496026 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-3cdfa62a-f2d9-466c-a2c2-6f15487cd169 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:51.496632 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-3cdfa62a-f2d9-466c-a2c2-6f15487cd169 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:51.504031 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3cdfa62a-f2d9-466c-a2c2-6f15487cd169 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:51.504751 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3cdfa62a-f2d9-466c-a2c2-6f15487cd169 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:51.505367 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3cdfa62a-f2d9-466c-a2c2-6f15487cd169 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:51.506230 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3cdfa62a-f2d9-466c-a2c2-6f15487cd169 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:51.506841 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3cdfa62a-f2d9-466c-a2c2-6f15487cd169 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:51.507265 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3cdfa62a-f2d9-466c-a2c2-6f15487cd169 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:51.586527 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-3cdfa62a-f2d9-466c-a2c2-6f15487cd169 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:51.595065 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-3cdfa62a-f2d9-466c-a2c2-6f15487cd169 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:51.596629 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-3cdfa62a-f2d9-466c-a2c2-6f15487cd169 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:51.597882 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-3cdfa62a-f2d9-466c-a2c2-6f15487cd169 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1657 microversion: 2.20 time: 0.106039 Aug 12 01:34:51.598541 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 438/872] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:34:51 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1657 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 01:34:52.622289 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-a72d83e8-2558-4020-b69b-b7484817e5f6 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:52.622974 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-a72d83e8-2558-4020-b69b-b7484817e5f6 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:52.629306 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a72d83e8-2558-4020-b69b-b7484817e5f6 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:52.629777 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a72d83e8-2558-4020-b69b-b7484817e5f6 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:52.630203 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a72d83e8-2558-4020-b69b-b7484817e5f6 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:52.630920 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a72d83e8-2558-4020-b69b-b7484817e5f6 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:52.631320 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a72d83e8-2558-4020-b69b-b7484817e5f6 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:52.631764 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a72d83e8-2558-4020-b69b-b7484817e5f6 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:52.695287 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-a72d83e8-2558-4020-b69b-b7484817e5f6 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:52.703294 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-a72d83e8-2558-4020-b69b-b7484817e5f6 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:52.704823 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-a72d83e8-2558-4020-b69b-b7484817e5f6 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:52.705936 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-a72d83e8-2558-4020-b69b-b7484817e5f6 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1367 microversion: 2.20 time: 0.088616 Aug 12 01:34:52.706505 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 435/873] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:34:52 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:34:53.728793 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-b1cf6d60-abc3-4e6a-b65d-c59b74acebf4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:53.729775 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-b1cf6d60-abc3-4e6a-b65d-c59b74acebf4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:53.737038 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b1cf6d60-abc3-4e6a-b65d-c59b74acebf4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:53.737520 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b1cf6d60-abc3-4e6a-b65d-c59b74acebf4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:53.737973 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b1cf6d60-abc3-4e6a-b65d-c59b74acebf4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:53.738853 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b1cf6d60-abc3-4e6a-b65d-c59b74acebf4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:53.739558 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b1cf6d60-abc3-4e6a-b65d-c59b74acebf4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:53.740103 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b1cf6d60-abc3-4e6a-b65d-c59b74acebf4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:53.772262 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b1cf6d60-abc3-4e6a-b65d-c59b74acebf4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:53.772702 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b1cf6d60-abc3-4e6a-b65d-c59b74acebf4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:53.773144 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b1cf6d60-abc3-4e6a-b65d-c59b74acebf4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:53.773613 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.objects.instance [None req-b1cf6d60-abc3-4e6a-b65d-c59b74acebf4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lazy-loading 'fault' on Instance uuid f3d50f7a-89e5-4250-be37-7fdf4f9b79da {{(pid=120786) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 01:34:53.820851 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-b1cf6d60-abc3-4e6a-b65d-c59b74acebf4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:53.830188 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-b1cf6d60-abc3-4e6a-b65d-c59b74acebf4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:53.831687 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-b1cf6d60-abc3-4e6a-b65d-c59b74acebf4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be3709a7f73442e79e7d5ad0c9389ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d33b640693442238516535af8320529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:34:53.832829 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-b1cf6d60-abc3-4e6a-b65d-c59b74acebf4 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 200 len: 1372 microversion: 2.20 time: 0.108518 Aug 12 01:34:53.833383 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 439/874] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:34:53 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 1372 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 01:34:54.855443 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-4fe7daa1-0740-4f36-89a7-0c28f9ce70f2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:54.856096 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-4fe7daa1-0740-4f36-89a7-0c28f9ce70f2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:54.864975 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4fe7daa1-0740-4f36-89a7-0c28f9ce70f2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:54.865216 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4fe7daa1-0740-4f36-89a7-0c28f9ce70f2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:54.865652 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4fe7daa1-0740-4f36-89a7-0c28f9ce70f2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:54.866382 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4fe7daa1-0740-4f36-89a7-0c28f9ce70f2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:54.866830 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4fe7daa1-0740-4f36-89a7-0c28f9ce70f2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:54.867222 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4fe7daa1-0740-4f36-89a7-0c28f9ce70f2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:54.881386 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.wsgi [None req-4fe7daa1-0740-4f36-89a7-0c28f9ce70f2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] HTTP exception thrown: Instance f3d50f7a-89e5-4250-be37-7fdf4f9b79da could not be found. Aug 12 01:34:54.883116 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-4fe7daa1-0740-4f36-89a7-0c28f9ce70f2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Request method failure captured: Aug 12 01:34:54.883116 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: request: GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da HTTP/1.1 Aug 12 01:34:54.883116 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept: application/json Aug 12 01:34:54.883116 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept-Encoding: identity Aug 12 01:34:54.883116 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Connection: close Aug 12 01:34:54.883116 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Length: 0 Aug 12 01:34:54.883116 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Type: application/json Aug 12 01:34:54.883116 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Host: 10.222.0.20 Aug 12 01:34:54.883116 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Openstack-System-Scope: None Aug 12 01:34:54.883116 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: User-Agent: python-urllib3/1.26.11 Aug 12 01:34:54.883116 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Auth-Token: gAAAAABi9ayu67ZpanV5Ulpxh2Oe0Hcix-rTEgBTp0llyvT16FiTV27_rmSNyGask3IkdhTFcR2jIXguLeUhBc7htEodmUDR6h-5Y40cY5hhta-yFn_ddYys-HSimYLkapigbR2EYJqW0qs8dkp4N2CF-fav2L1laz_y2otDQD_L5dIvw2ec7_0 Aug 12 01:34:54.883116 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Id: None Aug 12 01:34:54.883116 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Name: None Aug 12 01:34:54.883116 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Identity-Status: Confirmed Aug 12 01:34:54.883116 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Is-Admin-Project: True Aug 12 01:34:54.883116 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Openstack-Nova-Api-Version: 2.20 Aug 12 01:34:54.883116 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Id: default Aug 12 01:34:54.883116 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Name: Default Aug 12 01:34:54.883116 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Id: 9d33b640693442238516535af8320529 Aug 12 01:34:54.883116 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1840757724 Aug 12 01:34:54.883116 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Role: member,reader Aug 12 01:34:54.883116 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Roles: member,reader Aug 12 01:34:54.884841 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d33b640693442238516535af8320529"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d33b640693442238516535af8320529"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d33b640693442238516535af8320529"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d33b640693442238516535af8320529"}]}] Aug 12 01:34:54.884841 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1840757724 Aug 12 01:34:54.884841 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Id: 9d33b640693442238516535af8320529 Aug 12 01:34:54.884841 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1840757724 Aug 12 01:34:54.884841 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User: tempest-AttachVolumeShelveTestJSON-1840757724-project Aug 12 01:34:54.884841 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Id: default Aug 12 01:34:54.884841 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Name: Default Aug 12 01:34:54.884841 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Id: be3709a7f73442e79e7d5ad0c9389ac1 Aug 12 01:34:54.884841 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1840757724-project Aug 12 01:34:54.884841 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: method: > Aug 12 01:34:54.884841 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: exception: Instance f3d50f7a-89e5-4250-be37-7fdf4f9b79da could not be found. Aug 12 01:34:54.884841 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: action_args: {'id': 'f3d50f7a-89e5-4250-be37-7fdf4f9b79da'} Aug 12 01:34:54.885967 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:34:54.885967 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:54.885967 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:34:54.885967 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:34:54.885967 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:34:54.885967 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:34:54.885967 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:34:54.885967 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:34:54.885967 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:34:54.885967 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:34:54.885967 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3d50f7a-89e5-4250-be37-7fdf4f9b79da could not be found. Aug 12 01:34:54.885967 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:54.885967 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:34:54.885967 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:54.885967 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:54.885967 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:34:54.885967 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:34:54.885967 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:34:54.885967 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:34:54.885967 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:34:54.888024 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:34:54.888024 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 01:34:54.888024 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 01:34:54.888024 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:34:54.888024 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:34:54.888024 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:34:54.888024 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:34:54.888024 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3d50f7a-89e5-4250-be37-7fdf4f9b79da could not be found. Aug 12 01:34:54.888024 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:54.888024 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:34:54.888024 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:54.888024 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:54.888024 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:34:54.888024 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:34:54.888024 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:34:54.888024 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:34:54.888024 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3d50f7a-89e5-4250-be37-7fdf4f9b79da could not be found. Aug 12 01:34:54.888024 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:54.889705 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-4fe7daa1-0740-4f36-89a7-0c28f9ce70f2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Returning 404 to user: Instance f3d50f7a-89e5-4250-be37-7fdf4f9b79da could not be found. {{(pid=120785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:34:54.889705 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-4fe7daa1-0740-4f36-89a7-0c28f9ce70f2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 404 len: 111 microversion: 2.20 time: 0.033323 Aug 12 01:34:54.889705 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 436/875] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:34:54 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 12 01:34:54.901189 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-911c0e35-ed99-4570-9ed2-31c1cdf15898 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '.version_select at 0x7f2deccd0b80>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:54.921755 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-911c0e35-ed99-4570-9ed2-31c1cdf15898 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1426147352" status: 204 len: 0 microversion: 2.20 time: 0.026028 Aug 12 01:34:54.922429 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 440/876] 10.222.0.20 () {60 vars in 1262 bytes} [Fri Aug 12 01:34:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1426147352 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 12 01:34:57.770726 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-7b732f7d-efa7-4908-a600-9c78e550d31f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:57.771312 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-7b732f7d-efa7-4908-a600-9c78e550d31f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:57.778535 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7b732f7d-efa7-4908-a600-9c78e550d31f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:57.779010 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7b732f7d-efa7-4908-a600-9c78e550d31f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:57.779432 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7b732f7d-efa7-4908-a600-9c78e550d31f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:57.780155 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7b732f7d-efa7-4908-a600-9c78e550d31f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:57.780687 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7b732f7d-efa7-4908-a600-9c78e550d31f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:57.781102 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-7b732f7d-efa7-4908-a600-9c78e550d31f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:57.795114 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.wsgi [None req-7b732f7d-efa7-4908-a600-9c78e550d31f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] HTTP exception thrown: Instance f3d50f7a-89e5-4250-be37-7fdf4f9b79da could not be found. Aug 12 01:34:57.796805 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-7b732f7d-efa7-4908-a600-9c78e550d31f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Request method failure captured: Aug 12 01:34:57.796805 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: request: DELETE /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da HTTP/1.1 Aug 12 01:34:57.796805 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept: application/json Aug 12 01:34:57.796805 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept-Encoding: identity Aug 12 01:34:57.796805 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Connection: close Aug 12 01:34:57.796805 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Length: 0 Aug 12 01:34:57.796805 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Type: application/json Aug 12 01:34:57.796805 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Host: 10.222.0.20 Aug 12 01:34:57.796805 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Openstack-System-Scope: None Aug 12 01:34:57.796805 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: User-Agent: python-urllib3/1.26.11 Aug 12 01:34:57.796805 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Auth-Token: gAAAAABi9ayu67ZpanV5Ulpxh2Oe0Hcix-rTEgBTp0llyvT16FiTV27_rmSNyGask3IkdhTFcR2jIXguLeUhBc7htEodmUDR6h-5Y40cY5hhta-yFn_ddYys-HSimYLkapigbR2EYJqW0qs8dkp4N2CF-fav2L1laz_y2otDQD_L5dIvw2ec7_0 Aug 12 01:34:57.796805 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Id: None Aug 12 01:34:57.796805 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Name: None Aug 12 01:34:57.796805 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Identity-Status: Confirmed Aug 12 01:34:57.796805 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Is-Admin-Project: True Aug 12 01:34:57.796805 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Openstack-Nova-Api-Version: 2.20 Aug 12 01:34:57.796805 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Id: default Aug 12 01:34:57.796805 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Name: Default Aug 12 01:34:57.796805 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Id: 9d33b640693442238516535af8320529 Aug 12 01:34:57.796805 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1840757724 Aug 12 01:34:57.796805 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Role: member,reader Aug 12 01:34:57.796805 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Roles: member,reader Aug 12 01:34:57.798571 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d33b640693442238516535af8320529"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d33b640693442238516535af8320529"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d33b640693442238516535af8320529"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d33b640693442238516535af8320529"}]}] Aug 12 01:34:57.798571 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1840757724 Aug 12 01:34:57.798571 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Id: 9d33b640693442238516535af8320529 Aug 12 01:34:57.798571 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1840757724 Aug 12 01:34:57.798571 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User: tempest-AttachVolumeShelveTestJSON-1840757724-project Aug 12 01:34:57.798571 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Id: default Aug 12 01:34:57.798571 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Name: Default Aug 12 01:34:57.798571 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Id: be3709a7f73442e79e7d5ad0c9389ac1 Aug 12 01:34:57.798571 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1840757724-project Aug 12 01:34:57.798571 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: method: > Aug 12 01:34:57.798571 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: exception: Instance f3d50f7a-89e5-4250-be37-7fdf4f9b79da could not be found. Aug 12 01:34:57.798571 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: action_args: {'id': 'f3d50f7a-89e5-4250-be37-7fdf4f9b79da'} Aug 12 01:34:57.799484 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:34:57.799484 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:57.799484 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:34:57.799484 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:34:57.799484 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:34:57.799484 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:34:57.799484 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:34:57.799484 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:34:57.799484 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:34:57.799484 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:34:57.799484 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3d50f7a-89e5-4250-be37-7fdf4f9b79da could not be found. Aug 12 01:34:57.799484 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:57.799484 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:34:57.799484 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:57.799484 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:57.799484 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:34:57.799484 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:34:57.799484 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:34:57.799484 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:34:57.799484 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:34:57.801945 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:34:57.801945 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 01:34:57.801945 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 01:34:57.801945 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 01:34:57.801945 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 01:34:57.801945 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:34:57.801945 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:34:57.801945 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:34:57.801945 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:34:57.801945 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3d50f7a-89e5-4250-be37-7fdf4f9b79da could not be found. Aug 12 01:34:57.801945 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:57.801945 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:34:57.801945 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:57.801945 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:57.801945 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:34:57.801945 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:34:57.801945 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:34:57.801945 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:34:57.801945 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3d50f7a-89e5-4250-be37-7fdf4f9b79da could not be found. Aug 12 01:34:57.801945 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:57.803311 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-7b732f7d-efa7-4908-a600-9c78e550d31f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Returning 404 to user: Instance f3d50f7a-89e5-4250-be37-7fdf4f9b79da could not be found. {{(pid=120785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:34:57.803311 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-7b732f7d-efa7-4908-a600-9c78e550d31f tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 404 len: 111 microversion: 2.20 time: 0.033332 Aug 12 01:34:57.803311 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 437/877] 10.222.0.20 () {60 vars in 1280 bytes} [Fri Aug 12 01:34:57 2022] DELETE /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 12 01:34:57.808447 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-fd7d9543-e5e1-4cba-b314-62c8d4a5c2c7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:57.809118 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-fd7d9543-e5e1-4cba-b314-62c8d4a5c2c7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: f3d50f7a-89e5-4250-be37-7fdf4f9b79da] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:57.815562 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fd7d9543-e5e1-4cba-b314-62c8d4a5c2c7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:57.816052 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fd7d9543-e5e1-4cba-b314-62c8d4a5c2c7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:57.816480 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fd7d9543-e5e1-4cba-b314-62c8d4a5c2c7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:57.817261 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fd7d9543-e5e1-4cba-b314-62c8d4a5c2c7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:57.817711 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fd7d9543-e5e1-4cba-b314-62c8d4a5c2c7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:57.818130 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-fd7d9543-e5e1-4cba-b314-62c8d4a5c2c7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:57.831034 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.wsgi [None req-fd7d9543-e5e1-4cba-b314-62c8d4a5c2c7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] HTTP exception thrown: Instance f3d50f7a-89e5-4250-be37-7fdf4f9b79da could not be found. Aug 12 01:34:57.832776 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-fd7d9543-e5e1-4cba-b314-62c8d4a5c2c7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Request method failure captured: Aug 12 01:34:57.832776 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: request: GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da HTTP/1.1 Aug 12 01:34:57.832776 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept: application/json Aug 12 01:34:57.832776 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept-Encoding: identity Aug 12 01:34:57.832776 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Connection: close Aug 12 01:34:57.832776 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Length: 0 Aug 12 01:34:57.832776 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Type: application/json Aug 12 01:34:57.832776 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Host: 10.222.0.20 Aug 12 01:34:57.832776 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Openstack-System-Scope: None Aug 12 01:34:57.832776 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: User-Agent: python-urllib3/1.26.11 Aug 12 01:34:57.832776 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Auth-Token: gAAAAABi9ayu67ZpanV5Ulpxh2Oe0Hcix-rTEgBTp0llyvT16FiTV27_rmSNyGask3IkdhTFcR2jIXguLeUhBc7htEodmUDR6h-5Y40cY5hhta-yFn_ddYys-HSimYLkapigbR2EYJqW0qs8dkp4N2CF-fav2L1laz_y2otDQD_L5dIvw2ec7_0 Aug 12 01:34:57.832776 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Id: None Aug 12 01:34:57.832776 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Name: None Aug 12 01:34:57.832776 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Identity-Status: Confirmed Aug 12 01:34:57.832776 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Is-Admin-Project: True Aug 12 01:34:57.832776 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Openstack-Nova-Api-Version: 2.20 Aug 12 01:34:57.832776 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Id: default Aug 12 01:34:57.832776 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Name: Default Aug 12 01:34:57.832776 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Id: 9d33b640693442238516535af8320529 Aug 12 01:34:57.832776 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1840757724 Aug 12 01:34:57.832776 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Role: member,reader Aug 12 01:34:57.832776 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Roles: member,reader Aug 12 01:34:57.834431 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d33b640693442238516535af8320529"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d33b640693442238516535af8320529"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d33b640693442238516535af8320529"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d33b640693442238516535af8320529"}]}] Aug 12 01:34:57.834431 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1840757724 Aug 12 01:34:57.834431 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Id: 9d33b640693442238516535af8320529 Aug 12 01:34:57.834431 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1840757724 Aug 12 01:34:57.834431 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User: tempest-AttachVolumeShelveTestJSON-1840757724-project Aug 12 01:34:57.834431 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Id: default Aug 12 01:34:57.834431 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Name: Default Aug 12 01:34:57.834431 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Id: be3709a7f73442e79e7d5ad0c9389ac1 Aug 12 01:34:57.834431 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1840757724-project Aug 12 01:34:57.834431 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: method: > Aug 12 01:34:57.834431 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: exception: Instance f3d50f7a-89e5-4250-be37-7fdf4f9b79da could not be found. Aug 12 01:34:57.834431 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: action_args: {'id': 'f3d50f7a-89e5-4250-be37-7fdf4f9b79da'} Aug 12 01:34:57.835427 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:34:57.835427 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:57.835427 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:34:57.835427 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:34:57.835427 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:34:57.835427 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:34:57.835427 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:34:57.835427 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:34:57.835427 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:34:57.835427 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:34:57.835427 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3d50f7a-89e5-4250-be37-7fdf4f9b79da could not be found. Aug 12 01:34:57.835427 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:57.835427 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:34:57.835427 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:57.835427 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:57.835427 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:34:57.835427 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:34:57.835427 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:34:57.835427 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:34:57.835427 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:34:57.836960 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:34:57.836960 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 01:34:57.836960 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 01:34:57.836960 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:34:57.836960 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:34:57.836960 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:34:57.836960 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:34:57.836960 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3d50f7a-89e5-4250-be37-7fdf4f9b79da could not be found. Aug 12 01:34:57.836960 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:57.836960 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:34:57.836960 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:57.836960 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:57.836960 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:34:57.836960 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:34:57.836960 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:34:57.836960 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:34:57.836960 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3d50f7a-89e5-4250-be37-7fdf4f9b79da could not be found. Aug 12 01:34:57.836960 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:57.838739 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-fd7d9543-e5e1-4cba-b314-62c8d4a5c2c7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Returning 404 to user: Instance f3d50f7a-89e5-4250-be37-7fdf4f9b79da could not be found. {{(pid=120786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:34:57.838739 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-fd7d9543-e5e1-4cba-b314-62c8d4a5c2c7 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da" status: 404 len: 111 microversion: 2.20 time: 0.030127 Aug 12 01:34:57.838739 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 441/878] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:34:57 2022] GET /compute/v2.1/servers/f3d50f7a-89e5-4250-be37-7fdf4f9b79da => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 12 01:34:58.973465 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-67db9060-5f03-4e07-bc07-defd968263c2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:58.974314 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-67db9060-5f03-4e07-bc07-defd968263c2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:58.976916 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_api:SELECT=28 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:34:58.984062 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-67db9060-5f03-4e07-bc07-defd968263c2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:58.984548 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-67db9060-5f03-4e07-bc07-defd968263c2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:58.984979 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-67db9060-5f03-4e07-bc07-defd968263c2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:58.985680 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-67db9060-5f03-4e07-bc07-defd968263c2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:58.986131 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-67db9060-5f03-4e07-bc07-defd968263c2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:58.986548 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-67db9060-5f03-4e07-bc07-defd968263c2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:58.991622 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=53 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:34:59.002515 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.wsgi [None req-67db9060-5f03-4e07-bc07-defd968263c2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] HTTP exception thrown: Instance 0ed5ced2-87ad-4d0f-860c-648bcca91ca8 could not be found. Aug 12 01:34:59.004495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-67db9060-5f03-4e07-bc07-defd968263c2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Request method failure captured: Aug 12 01:34:59.004495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: request: DELETE /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 HTTP/1.1 Aug 12 01:34:59.004495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept: application/json Aug 12 01:34:59.004495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept-Encoding: identity Aug 12 01:34:59.004495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Connection: close Aug 12 01:34:59.004495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Length: 0 Aug 12 01:34:59.004495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Type: application/json Aug 12 01:34:59.004495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Host: 10.222.0.20 Aug 12 01:34:59.004495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Openstack-System-Scope: None Aug 12 01:34:59.004495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: User-Agent: python-urllib3/1.26.11 Aug 12 01:34:59.004495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Auth-Token: gAAAAABi9ayu67ZpanV5Ulpxh2Oe0Hcix-rTEgBTp0llyvT16FiTV27_rmSNyGask3IkdhTFcR2jIXguLeUhBc7htEodmUDR6h-5Y40cY5hhta-yFn_ddYys-HSimYLkapigbR2EYJqW0qs8dkp4N2CF-fav2L1laz_y2otDQD_L5dIvw2ec7_0 Aug 12 01:34:59.004495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Id: None Aug 12 01:34:59.004495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Name: None Aug 12 01:34:59.004495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Identity-Status: Confirmed Aug 12 01:34:59.004495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Is-Admin-Project: True Aug 12 01:34:59.004495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Openstack-Nova-Api-Version: 2.20 Aug 12 01:34:59.004495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Id: default Aug 12 01:34:59.004495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Name: Default Aug 12 01:34:59.004495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Id: 9d33b640693442238516535af8320529 Aug 12 01:34:59.004495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1840757724 Aug 12 01:34:59.004495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Role: member,reader Aug 12 01:34:59.004495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Roles: member,reader Aug 12 01:34:59.006136 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d33b640693442238516535af8320529"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d33b640693442238516535af8320529"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d33b640693442238516535af8320529"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d33b640693442238516535af8320529"}]}] Aug 12 01:34:59.006136 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1840757724 Aug 12 01:34:59.006136 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Id: 9d33b640693442238516535af8320529 Aug 12 01:34:59.006136 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1840757724 Aug 12 01:34:59.006136 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User: tempest-AttachVolumeShelveTestJSON-1840757724-project Aug 12 01:34:59.006136 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Id: default Aug 12 01:34:59.006136 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Name: Default Aug 12 01:34:59.006136 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Id: be3709a7f73442e79e7d5ad0c9389ac1 Aug 12 01:34:59.006136 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1840757724-project Aug 12 01:34:59.006136 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: method: > Aug 12 01:34:59.006136 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: exception: Instance 0ed5ced2-87ad-4d0f-860c-648bcca91ca8 could not be found. Aug 12 01:34:59.006136 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: action_args: {'id': '0ed5ced2-87ad-4d0f-860c-648bcca91ca8'} Aug 12 01:34:59.006931 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:34:59.006931 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:59.006931 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:34:59.006931 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:34:59.006931 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:34:59.006931 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:34:59.006931 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:34:59.006931 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:34:59.006931 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:34:59.006931 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:34:59.006931 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ed5ced2-87ad-4d0f-860c-648bcca91ca8 could not be found. Aug 12 01:34:59.006931 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:59.006931 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:34:59.006931 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:59.006931 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:59.006931 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:34:59.006931 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:34:59.006931 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:34:59.006931 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:34:59.006931 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:34:59.008309 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:34:59.008309 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 01:34:59.008309 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 01:34:59.008309 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 01:34:59.008309 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 01:34:59.008309 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:34:59.008309 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:34:59.008309 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:34:59.008309 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:34:59.008309 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ed5ced2-87ad-4d0f-860c-648bcca91ca8 could not be found. Aug 12 01:34:59.008309 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:59.008309 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:34:59.008309 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:59.008309 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:59.008309 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:34:59.008309 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:34:59.008309 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:34:59.008309 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:34:59.008309 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ed5ced2-87ad-4d0f-860c-648bcca91ca8 could not be found. Aug 12 01:34:59.008309 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:34:59.009616 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-67db9060-5f03-4e07-bc07-defd968263c2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Returning 404 to user: Instance 0ed5ced2-87ad-4d0f-860c-648bcca91ca8 could not be found. {{(pid=120785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:34:59.009616 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-67db9060-5f03-4e07-bc07-defd968263c2 tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 404 len: 111 microversion: 2.20 time: 0.037528 Aug 12 01:34:59.009616 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 438/879] 10.222.0.20 () {60 vars in 1280 bytes} [Fri Aug 12 01:34:58 2022] DELETE /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 12 01:34:59.017122 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-98922035-5309-4a96-ac86-01454f0af4ba tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:34:59.017791 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-98922035-5309-4a96-ac86-01454f0af4ba tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] [instance: 0ed5ced2-87ad-4d0f-860c-648bcca91ca8] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:34:59.024517 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-98922035-5309-4a96-ac86-01454f0af4ba tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:59.024997 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-98922035-5309-4a96-ac86-01454f0af4ba tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:59.025421 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-98922035-5309-4a96-ac86-01454f0af4ba tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:59.026114 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-98922035-5309-4a96-ac86-01454f0af4ba tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:34:59.026557 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-98922035-5309-4a96-ac86-01454f0af4ba tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:34:59.026974 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-98922035-5309-4a96-ac86-01454f0af4ba tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:34:59.041682 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.wsgi [None req-98922035-5309-4a96-ac86-01454f0af4ba tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] HTTP exception thrown: Instance 0ed5ced2-87ad-4d0f-860c-648bcca91ca8 could not be found. Aug 12 01:34:59.043232 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-98922035-5309-4a96-ac86-01454f0af4ba tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Request method failure captured: Aug 12 01:34:59.043232 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: request: GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 HTTP/1.1 Aug 12 01:34:59.043232 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept: application/json Aug 12 01:34:59.043232 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept-Encoding: identity Aug 12 01:34:59.043232 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Connection: close Aug 12 01:34:59.043232 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Length: 0 Aug 12 01:34:59.043232 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Type: application/json Aug 12 01:34:59.043232 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Host: 10.222.0.20 Aug 12 01:34:59.043232 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Openstack-System-Scope: None Aug 12 01:34:59.043232 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: User-Agent: python-urllib3/1.26.11 Aug 12 01:34:59.043232 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Auth-Token: gAAAAABi9ayu67ZpanV5Ulpxh2Oe0Hcix-rTEgBTp0llyvT16FiTV27_rmSNyGask3IkdhTFcR2jIXguLeUhBc7htEodmUDR6h-5Y40cY5hhta-yFn_ddYys-HSimYLkapigbR2EYJqW0qs8dkp4N2CF-fav2L1laz_y2otDQD_L5dIvw2ec7_0 Aug 12 01:34:59.043232 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Id: None Aug 12 01:34:59.043232 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Name: None Aug 12 01:34:59.043232 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Identity-Status: Confirmed Aug 12 01:34:59.043232 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Is-Admin-Project: True Aug 12 01:34:59.043232 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Openstack-Nova-Api-Version: 2.20 Aug 12 01:34:59.043232 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Id: default Aug 12 01:34:59.043232 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Name: Default Aug 12 01:34:59.043232 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Id: 9d33b640693442238516535af8320529 Aug 12 01:34:59.043232 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1840757724 Aug 12 01:34:59.043232 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Role: member,reader Aug 12 01:34:59.043232 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Roles: member,reader Aug 12 01:34:59.045057 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9d33b640693442238516535af8320529"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d33b640693442238516535af8320529"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9d33b640693442238516535af8320529"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9d33b640693442238516535af8320529"}]}] Aug 12 01:34:59.045057 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1840757724 Aug 12 01:34:59.045057 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Id: 9d33b640693442238516535af8320529 Aug 12 01:34:59.045057 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1840757724 Aug 12 01:34:59.045057 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User: tempest-AttachVolumeShelveTestJSON-1840757724-project Aug 12 01:34:59.045057 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Id: default Aug 12 01:34:59.045057 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Name: Default Aug 12 01:34:59.045057 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Id: be3709a7f73442e79e7d5ad0c9389ac1 Aug 12 01:34:59.045057 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1840757724-project Aug 12 01:34:59.045057 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: method: > Aug 12 01:34:59.045057 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: exception: Instance 0ed5ced2-87ad-4d0f-860c-648bcca91ca8 could not be found. Aug 12 01:34:59.045057 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: action_args: {'id': '0ed5ced2-87ad-4d0f-860c-648bcca91ca8'} Aug 12 01:34:59.046125 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:34:59.046125 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:59.046125 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:34:59.046125 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:34:59.046125 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:34:59.046125 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:34:59.046125 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:34:59.046125 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:34:59.046125 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:34:59.046125 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:34:59.046125 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ed5ced2-87ad-4d0f-860c-648bcca91ca8 could not be found. Aug 12 01:34:59.046125 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:59.046125 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:34:59.046125 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:59.046125 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:59.046125 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:34:59.046125 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:34:59.046125 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:34:59.046125 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:34:59.046125 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:34:59.047657 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:34:59.047657 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 01:34:59.047657 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 01:34:59.047657 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:34:59.047657 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:34:59.047657 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:34:59.047657 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:34:59.047657 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ed5ced2-87ad-4d0f-860c-648bcca91ca8 could not be found. Aug 12 01:34:59.047657 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:59.047657 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:34:59.047657 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:59.047657 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:34:59.047657 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:34:59.047657 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:34:59.047657 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:34:59.047657 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:34:59.047657 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ed5ced2-87ad-4d0f-860c-648bcca91ca8 could not be found. Aug 12 01:34:59.047657 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:34:59.049106 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-98922035-5309-4a96-ac86-01454f0af4ba tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] Returning 404 to user: Instance 0ed5ced2-87ad-4d0f-860c-648bcca91ca8 could not be found. {{(pid=120786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:34:59.049106 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-98922035-5309-4a96-ac86-01454f0af4ba tempest-AttachVolumeShelveTestJSON-1840757724 tempest-AttachVolumeShelveTestJSON-1840757724-project] 10.222.0.20 "GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8" status: 404 len: 111 microversion: 2.20 time: 0.032791 Aug 12 01:34:59.049106 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 442/880] 10.222.0.20 () {60 vars in 1277 bytes} [Fri Aug 12 01:34:59 2022] GET /compute/v2.1/servers/0ed5ced2-87ad-4d0f-860c-648bcca91ca8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 12 01:35:19.137666 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-36ed7cbd-e0f8-42f2-ac6f-9d9a1b3bf1b3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1513552419", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-140950627", "security_groups": [{"name": "tempest-secgroup-smoke-531838359"}], "block_device_mapping_v2": [{"uuid": "e85c62ae-b527-41df-ba62-c51f9dccc297", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4d3c14b0-d6e3-49a6-94a3-2110714459d1"}]}} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:35:19.148593 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_api:SELECT=1 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:35:19.256150 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.network.neutron [None req-36ed7cbd-e0f8-42f2-ac6f-9d9a1b3bf1b3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] validate_networks() for [('4d3c14b0-d6e3-49a6-94a3-2110714459d1', None, None, None, None, None)] {{(pid=120785) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 01:35:19.757745 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-36ed7cbd-e0f8-42f2-ac6f-9d9a1b3bf1b3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Flavor limits 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 01:35:19.758167 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-36ed7cbd-e0f8-42f2-ac6f-9d9a1b3bf1b3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Image limits 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 01:35:19.758660 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-36ed7cbd-e0f8-42f2-ac6f-9d9a1b3bf1b3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Flavor pref 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 01:35:19.759057 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-36ed7cbd-e0f8-42f2-ac6f-9d9a1b3bf1b3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Image pref 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 01:35:19.759458 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-36ed7cbd-e0f8-42f2-ac6f-9d9a1b3bf1b3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 01:35:19.768602 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-36ed7cbd-e0f8-42f2-ac6f-9d9a1b3bf1b3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:19.769161 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-36ed7cbd-e0f8-42f2-ac6f-9d9a1b3bf1b3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:19.769593 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-36ed7cbd-e0f8-42f2-ac6f-9d9a1b3bf1b3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:19.770305 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-36ed7cbd-e0f8-42f2-ac6f-9d9a1b3bf1b3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:19.770750 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-36ed7cbd-e0f8-42f2-ac6f-9d9a1b3bf1b3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:19.771162 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-36ed7cbd-e0f8-42f2-ac6f-9d9a1b3bf1b3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:19.787478 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.quota [None req-36ed7cbd-e0f8-42f2-ac6f-9d9a1b3bf1b3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Getting quotas for project 2ca05e52a1c94aa7a8877ea34c412c95. Resources: {'cores', 'ram', 'instances'} {{(pid=120785) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 01:35:19.791403 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.quota [None req-36ed7cbd-e0f8-42f2-ac6f-9d9a1b3bf1b3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Getting quotas for user 166e2f065c674cc0a6465f3d0d6bbb4d and project 2ca05e52a1c94aa7a8877ea34c412c95. Resources: {'cores', 'ram', 'instances'} {{(pid=120785) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 01:35:19.852353 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-36ed7cbd-e0f8-42f2-ac6f-9d9a1b3bf1b3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Going to run 1 instances... {{(pid=120785) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 01:35:19.854450 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-36ed7cbd-e0f8-42f2-ac6f-9d9a1b3bf1b3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: 8c36d121-4610-4641-b12a-680daf8cf440] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e85c62ae-b527-41df-ba62-c51f9dccc297',volume_size=None,volume_type=None)] {{(pid=120785) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 01:35:19.989599 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-36ed7cbd-e0f8-42f2-ac6f-9d9a1b3bf1b3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.855887 Aug 12 01:35:19.990723 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 439/881] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 01:35:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 01:35:20.006717 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-49e11377-331b-4c38-bbc4-c383cb21048d tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:35:20.009788 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-49e11377-331b-4c38-bbc4-c383cb21048d tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: 8c36d121-4610-4641-b12a-680daf8cf440] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:35:20.012496 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:35:20.013137 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:35:20.094016 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-49e11377-331b-4c38-bbc4-c383cb21048d tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:35:20.101854 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-49e11377-331b-4c38-bbc4-c383cb21048d tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440" status: 200 len: 1094 microversion: 2.1 time: 0.104722 Aug 12 01:35:20.102462 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 443/882] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:35:19 2022] GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440 => generated 1094 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:35:21.123590 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-29c04e42-c969-4345-a70b-30cfc8b8b2fb tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:35:21.125065 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-29c04e42-c969-4345-a70b-30cfc8b8b2fb tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: 8c36d121-4610-4641-b12a-680daf8cf440] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:35:21.134103 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-29c04e42-c969-4345-a70b-30cfc8b8b2fb tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:21.134597 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-29c04e42-c969-4345-a70b-30cfc8b8b2fb tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:21.135032 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-29c04e42-c969-4345-a70b-30cfc8b8b2fb tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:21.135941 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-29c04e42-c969-4345-a70b-30cfc8b8b2fb tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:21.136550 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-29c04e42-c969-4345-a70b-30cfc8b8b2fb tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:21.137740 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-29c04e42-c969-4345-a70b-30cfc8b8b2fb tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:21.230093 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-29c04e42-c969-4345-a70b-30cfc8b8b2fb tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:35:21.241539 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-29c04e42-c969-4345-a70b-30cfc8b8b2fb tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440" status: 200 len: 1210 microversion: 2.1 time: 0.122882 Aug 12 01:35:21.242444 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 440/883] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:35:21 2022] GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440 => generated 1210 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:35:22.265090 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-b132f23e-5eae-4a66-829d-645bb47d45b9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:35:22.266688 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-b132f23e-5eae-4a66-829d-645bb47d45b9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: 8c36d121-4610-4641-b12a-680daf8cf440] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:35:22.280237 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b132f23e-5eae-4a66-829d-645bb47d45b9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:22.281131 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b132f23e-5eae-4a66-829d-645bb47d45b9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:22.282233 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b132f23e-5eae-4a66-829d-645bb47d45b9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:22.283368 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b132f23e-5eae-4a66-829d-645bb47d45b9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:22.284205 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b132f23e-5eae-4a66-829d-645bb47d45b9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:22.285087 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b132f23e-5eae-4a66-829d-645bb47d45b9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:22.506957 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-b132f23e-5eae-4a66-829d-645bb47d45b9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:35:22.517622 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-b132f23e-5eae-4a66-829d-645bb47d45b9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440" status: 200 len: 1265 microversion: 2.1 time: 0.259192 Aug 12 01:35:22.518202 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 444/884] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:35:22 2022] GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440 => generated 1265 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:35:23.269379 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-aeb72dfa-ad07-4d54-bf3c-98731cbff97d req-55309cd8-36fc-425b-84c7-59aba71ba283 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c36d121-4610-4641-b12a-680daf8cf440", "tag": "1e026290-e0ea-4142-992c-806bce55dee6"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:35:23.283409 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-aeb72dfa-ad07-4d54-bf3c-98731cbff97d req-55309cd8-36fc-425b-84c7-59aba71ba283 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:23.284162 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-aeb72dfa-ad07-4d54-bf3c-98731cbff97d req-55309cd8-36fc-425b-84c7-59aba71ba283 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:23.284803 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-aeb72dfa-ad07-4d54-bf3c-98731cbff97d req-55309cd8-36fc-425b-84c7-59aba71ba283 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:23.299101 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-aeb72dfa-ad07-4d54-bf3c-98731cbff97d req-55309cd8-36fc-425b-84c7-59aba71ba283 service nova] Creating event network-changed:1e026290-e0ea-4142-992c-806bce55dee6 for instance 8c36d121-4610-4641-b12a-680daf8cf440 on hv-cinder-78481 Aug 12 01:35:23.305819 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-aeb72dfa-ad07-4d54-bf3c-98731cbff97d req-55309cd8-36fc-425b-84c7-59aba71ba283 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040054 Aug 12 01:35:23.306709 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 441/885] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:35:23.540259 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-6ea2a7d8-0024-43c9-ab26-a6626cd59a11 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:35:23.541554 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-6ea2a7d8-0024-43c9-ab26-a6626cd59a11 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: 8c36d121-4610-4641-b12a-680daf8cf440] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:35:23.548877 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6ea2a7d8-0024-43c9-ab26-a6626cd59a11 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:23.549662 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6ea2a7d8-0024-43c9-ab26-a6626cd59a11 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:23.550429 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6ea2a7d8-0024-43c9-ab26-a6626cd59a11 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:23.551430 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6ea2a7d8-0024-43c9-ab26-a6626cd59a11 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:23.551926 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6ea2a7d8-0024-43c9-ab26-a6626cd59a11 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:23.552337 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-6ea2a7d8-0024-43c9-ab26-a6626cd59a11 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:23.722179 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-6ea2a7d8-0024-43c9-ab26-a6626cd59a11 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:35:23.731635 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-6ea2a7d8-0024-43c9-ab26-a6626cd59a11 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440" status: 200 len: 1265 microversion: 2.1 time: 0.196124 Aug 12 01:35:23.732229 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 445/886] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:35:23 2022] GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440 => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:35:24.756922 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-86b31d21-8085-416a-8276-4c34e8ca86f8 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:35:24.757648 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-86b31d21-8085-416a-8276-4c34e8ca86f8 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: 8c36d121-4610-4641-b12a-680daf8cf440] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:35:24.766791 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-86b31d21-8085-416a-8276-4c34e8ca86f8 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:24.767450 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-86b31d21-8085-416a-8276-4c34e8ca86f8 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:24.768123 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-86b31d21-8085-416a-8276-4c34e8ca86f8 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:24.769232 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-86b31d21-8085-416a-8276-4c34e8ca86f8 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:24.769909 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-86b31d21-8085-416a-8276-4c34e8ca86f8 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:24.770514 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-86b31d21-8085-416a-8276-4c34e8ca86f8 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:24.908688 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-86b31d21-8085-416a-8276-4c34e8ca86f8 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:35:24.920457 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-86b31d21-8085-416a-8276-4c34e8ca86f8 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440" status: 200 len: 1265 microversion: 2.1 time: 0.170084 Aug 12 01:35:24.921245 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 442/887] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:35:24 2022] GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:35:25.952118 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-af11b8ea-1f1f-43cb-9e86-63dc3d24bc58 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:35:25.956072 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-af11b8ea-1f1f-43cb-9e86-63dc3d24bc58 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: 8c36d121-4610-4641-b12a-680daf8cf440] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:35:25.962752 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-af11b8ea-1f1f-43cb-9e86-63dc3d24bc58 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:25.963232 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-af11b8ea-1f1f-43cb-9e86-63dc3d24bc58 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:25.963689 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-af11b8ea-1f1f-43cb-9e86-63dc3d24bc58 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:25.964386 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-af11b8ea-1f1f-43cb-9e86-63dc3d24bc58 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:25.964809 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-af11b8ea-1f1f-43cb-9e86-63dc3d24bc58 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:25.965241 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-af11b8ea-1f1f-43cb-9e86-63dc3d24bc58 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:26.104525 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-af11b8ea-1f1f-43cb-9e86-63dc3d24bc58 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:35:26.112739 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-af11b8ea-1f1f-43cb-9e86-63dc3d24bc58 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440" status: 200 len: 1265 microversion: 2.1 time: 0.172058 Aug 12 01:35:26.113295 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 446/888] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:35:25 2022] GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:35:27.135139 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-365593bc-9b73-44b4-b350-d7626607ca53 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:35:27.136546 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-365593bc-9b73-44b4-b350-d7626607ca53 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: 8c36d121-4610-4641-b12a-680daf8cf440] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:35:27.143170 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-365593bc-9b73-44b4-b350-d7626607ca53 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:27.143680 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-365593bc-9b73-44b4-b350-d7626607ca53 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:27.144112 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-365593bc-9b73-44b4-b350-d7626607ca53 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:27.144775 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-365593bc-9b73-44b4-b350-d7626607ca53 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:27.145391 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-365593bc-9b73-44b4-b350-d7626607ca53 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:27.145991 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-365593bc-9b73-44b4-b350-d7626607ca53 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:27.320518 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-365593bc-9b73-44b4-b350-d7626607ca53 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:35:27.328101 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-365593bc-9b73-44b4-b350-d7626607ca53 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440" status: 200 len: 1265 microversion: 2.1 time: 0.196760 Aug 12 01:35:27.328664 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 443/889] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:35:27 2022] GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440 => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:35:28.360031 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-f8ed7e08-3dee-498b-ad29-0fe8885828fa tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:35:28.361118 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-f8ed7e08-3dee-498b-ad29-0fe8885828fa tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: 8c36d121-4610-4641-b12a-680daf8cf440] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:35:28.368194 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f8ed7e08-3dee-498b-ad29-0fe8885828fa tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:28.368674 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f8ed7e08-3dee-498b-ad29-0fe8885828fa tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:28.369099 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f8ed7e08-3dee-498b-ad29-0fe8885828fa tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:28.370000 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f8ed7e08-3dee-498b-ad29-0fe8885828fa tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:28.370626 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f8ed7e08-3dee-498b-ad29-0fe8885828fa tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:28.371338 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f8ed7e08-3dee-498b-ad29-0fe8885828fa tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:28.519286 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-f8ed7e08-3dee-498b-ad29-0fe8885828fa tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:35:28.527080 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-f8ed7e08-3dee-498b-ad29-0fe8885828fa tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440" status: 200 len: 1265 microversion: 2.1 time: 0.179234 Aug 12 01:35:28.527819 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 447/890] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:35:28 2022] GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:35:29.549852 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-63babf58-0a79-4480-88df-45e43874c4b2 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:35:29.550518 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-63babf58-0a79-4480-88df-45e43874c4b2 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: 8c36d121-4610-4641-b12a-680daf8cf440] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:35:29.557332 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-63babf58-0a79-4480-88df-45e43874c4b2 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:29.557810 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-63babf58-0a79-4480-88df-45e43874c4b2 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:29.558238 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-63babf58-0a79-4480-88df-45e43874c4b2 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:29.558922 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-63babf58-0a79-4480-88df-45e43874c4b2 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:29.559368 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-63babf58-0a79-4480-88df-45e43874c4b2 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:29.559913 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-63babf58-0a79-4480-88df-45e43874c4b2 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:29.778612 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell0:SELECT=2 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:35:29.802022 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell0:SELECT=6 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:35:29.856722 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-63babf58-0a79-4480-88df-45e43874c4b2 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:35:29.864793 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-63babf58-0a79-4480-88df-45e43874c4b2 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440" status: 200 len: 1265 microversion: 2.1 time: 0.320109 Aug 12 01:35:29.865364 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 444/891] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:35:29 2022] GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440 => generated 1265 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:35:30.886748 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-10b367c3-c847-4193-bb86-c2a6bf954e8e tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:35:30.887324 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-10b367c3-c847-4193-bb86-c2a6bf954e8e tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: 8c36d121-4610-4641-b12a-680daf8cf440] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:35:30.889640 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell0:SELECT=2 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:35:30.895415 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-10b367c3-c847-4193-bb86-c2a6bf954e8e tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:30.895822 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-10b367c3-c847-4193-bb86-c2a6bf954e8e tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:30.896255 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-10b367c3-c847-4193-bb86-c2a6bf954e8e tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:30.896946 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-10b367c3-c847-4193-bb86-c2a6bf954e8e tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:30.897395 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-10b367c3-c847-4193-bb86-c2a6bf954e8e tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:30.897813 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-10b367c3-c847-4193-bb86-c2a6bf954e8e tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:31.042144 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-10b367c3-c847-4193-bb86-c2a6bf954e8e tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:35:31.050183 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-10b367c3-c847-4193-bb86-c2a6bf954e8e tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440" status: 200 len: 1265 microversion: 2.1 time: 0.167590 Aug 12 01:35:31.050749 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 448/892] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:35:30 2022] GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:35:32.073010 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-44c79195-50d3-4373-bea5-417a1803c9c2 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:35:32.073786 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-44c79195-50d3-4373-bea5-417a1803c9c2 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: 8c36d121-4610-4641-b12a-680daf8cf440] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:35:32.080940 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-44c79195-50d3-4373-bea5-417a1803c9c2 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:32.081413 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-44c79195-50d3-4373-bea5-417a1803c9c2 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:32.081872 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-44c79195-50d3-4373-bea5-417a1803c9c2 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:32.082559 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-44c79195-50d3-4373-bea5-417a1803c9c2 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:32.083033 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-44c79195-50d3-4373-bea5-417a1803c9c2 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:32.083451 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-44c79195-50d3-4373-bea5-417a1803c9c2 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:32.220259 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-44c79195-50d3-4373-bea5-417a1803c9c2 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:35:32.227980 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-44c79195-50d3-4373-bea5-417a1803c9c2 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440" status: 200 len: 1265 microversion: 2.1 time: 0.161306 Aug 12 01:35:32.228531 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 445/893] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:35:32 2022] GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:35:33.251982 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-0fd2b340-6cb1-4791-990c-5843b8b712e3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:35:33.252834 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-0fd2b340-6cb1-4791-990c-5843b8b712e3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: 8c36d121-4610-4641-b12a-680daf8cf440] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:35:33.262986 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0fd2b340-6cb1-4791-990c-5843b8b712e3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:33.263473 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0fd2b340-6cb1-4791-990c-5843b8b712e3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:33.263946 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0fd2b340-6cb1-4791-990c-5843b8b712e3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:33.264642 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0fd2b340-6cb1-4791-990c-5843b8b712e3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:33.265085 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0fd2b340-6cb1-4791-990c-5843b8b712e3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:33.265495 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-0fd2b340-6cb1-4791-990c-5843b8b712e3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:33.408961 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-0fd2b340-6cb1-4791-990c-5843b8b712e3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:35:33.417091 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-0fd2b340-6cb1-4791-990c-5843b8b712e3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440" status: 200 len: 1265 microversion: 2.1 time: 0.171179 Aug 12 01:35:33.417631 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 449/894] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:35:33 2022] GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:35:34.442882 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-6f36b841-9ae1-499f-bd1b-b278f56115df tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:35:34.443462 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-6f36b841-9ae1-499f-bd1b-b278f56115df tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: 8c36d121-4610-4641-b12a-680daf8cf440] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:35:34.453356 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6f36b841-9ae1-499f-bd1b-b278f56115df tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:34.454029 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6f36b841-9ae1-499f-bd1b-b278f56115df tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:34.454683 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6f36b841-9ae1-499f-bd1b-b278f56115df tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:34.455524 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6f36b841-9ae1-499f-bd1b-b278f56115df tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:34.456171 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6f36b841-9ae1-499f-bd1b-b278f56115df tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:34.456722 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6f36b841-9ae1-499f-bd1b-b278f56115df tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:34.599777 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-6f36b841-9ae1-499f-bd1b-b278f56115df tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:35:34.611231 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-6f36b841-9ae1-499f-bd1b-b278f56115df tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440" status: 200 len: 1265 microversion: 2.1 time: 0.175182 Aug 12 01:35:34.612036 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 446/895] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:35:34 2022] GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:35:35.496208 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-6f92fa4e-c8f2-4189-8c94-73f53d50bac3 req-81531ba2-5e5a-4023-ae55-fccb7e556416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c36d121-4610-4641-b12a-680daf8cf440", "name": "network-vif-plugged", "status": "completed", "tag": "1e026290-e0ea-4142-992c-806bce55dee6"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:35:35.508506 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-6f92fa4e-c8f2-4189-8c94-73f53d50bac3 req-81531ba2-5e5a-4023-ae55-fccb7e556416 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:35.509062 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-6f92fa4e-c8f2-4189-8c94-73f53d50bac3 req-81531ba2-5e5a-4023-ae55-fccb7e556416 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:35.509705 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-6f92fa4e-c8f2-4189-8c94-73f53d50bac3 req-81531ba2-5e5a-4023-ae55-fccb7e556416 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:35.522270 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-6f92fa4e-c8f2-4189-8c94-73f53d50bac3 req-81531ba2-5e5a-4023-ae55-fccb7e556416 service nova] Creating event network-vif-plugged:1e026290-e0ea-4142-992c-806bce55dee6 for instance 8c36d121-4610-4641-b12a-680daf8cf440 on hv-cinder-78481 Aug 12 01:35:35.527402 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-6f92fa4e-c8f2-4189-8c94-73f53d50bac3 req-81531ba2-5e5a-4023-ae55-fccb7e556416 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035269 Aug 12 01:35:35.528032 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 450/896] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:35:35.636025 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-ea7a2507-941e-4ee4-b4a1-23e7d26e7487 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:35:35.636575 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-ea7a2507-941e-4ee4-b4a1-23e7d26e7487 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: 8c36d121-4610-4641-b12a-680daf8cf440] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:35:35.646274 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ea7a2507-941e-4ee4-b4a1-23e7d26e7487 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:35.646757 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ea7a2507-941e-4ee4-b4a1-23e7d26e7487 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:35.647185 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ea7a2507-941e-4ee4-b4a1-23e7d26e7487 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:35.647915 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ea7a2507-941e-4ee4-b4a1-23e7d26e7487 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:35.648360 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ea7a2507-941e-4ee4-b4a1-23e7d26e7487 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:35.648752 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ea7a2507-941e-4ee4-b4a1-23e7d26e7487 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:35.812534 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-ea7a2507-941e-4ee4-b4a1-23e7d26e7487 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:35:35.820589 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-ea7a2507-941e-4ee4-b4a1-23e7d26e7487 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440" status: 200 len: 1265 microversion: 2.1 time: 0.188486 Aug 12 01:35:35.821152 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 447/897] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:35:35 2022] GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:35:36.847490 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-ef6cd593-4001-4282-a86e-76ddbe48ef9f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:35:36.848664 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-ef6cd593-4001-4282-a86e-76ddbe48ef9f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: 8c36d121-4610-4641-b12a-680daf8cf440] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:35:36.859137 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ef6cd593-4001-4282-a86e-76ddbe48ef9f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:36.859996 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ef6cd593-4001-4282-a86e-76ddbe48ef9f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:36.860750 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ef6cd593-4001-4282-a86e-76ddbe48ef9f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:36.861856 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ef6cd593-4001-4282-a86e-76ddbe48ef9f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:36.862595 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ef6cd593-4001-4282-a86e-76ddbe48ef9f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:36.863299 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ef6cd593-4001-4282-a86e-76ddbe48ef9f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:37.010111 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-ef6cd593-4001-4282-a86e-76ddbe48ef9f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:35:37.018428 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-ef6cd593-4001-4282-a86e-76ddbe48ef9f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440" status: 200 len: 1265 microversion: 2.1 time: 0.179068 Aug 12 01:35:37.019165 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 451/898] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:35:36 2022] GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:35:38.039007 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-4c8d38f8-c065-4029-a17e-49f7f2bff76d tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:35:38.039487 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-4c8d38f8-c065-4029-a17e-49f7f2bff76d tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: 8c36d121-4610-4641-b12a-680daf8cf440] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:35:38.046110 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4c8d38f8-c065-4029-a17e-49f7f2bff76d tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:38.046600 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4c8d38f8-c065-4029-a17e-49f7f2bff76d tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:38.047056 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4c8d38f8-c065-4029-a17e-49f7f2bff76d tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:38.047782 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4c8d38f8-c065-4029-a17e-49f7f2bff76d tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:38.048231 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4c8d38f8-c065-4029-a17e-49f7f2bff76d tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:38.048650 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4c8d38f8-c065-4029-a17e-49f7f2bff76d tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:38.187224 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-4c8d38f8-c065-4029-a17e-49f7f2bff76d tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:35:38.194932 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-4c8d38f8-c065-4029-a17e-49f7f2bff76d tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440" status: 200 len: 1265 microversion: 2.1 time: 0.159884 Aug 12 01:35:38.195496 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 448/899] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:35:38 2022] GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:35:39.219410 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-f97edb3f-2e4e-46f8-9804-0a91a2fd6baa tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:35:39.220448 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-f97edb3f-2e4e-46f8-9804-0a91a2fd6baa tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: 8c36d121-4610-4641-b12a-680daf8cf440] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:35:39.231347 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f97edb3f-2e4e-46f8-9804-0a91a2fd6baa tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:39.232082 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f97edb3f-2e4e-46f8-9804-0a91a2fd6baa tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:39.232799 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f97edb3f-2e4e-46f8-9804-0a91a2fd6baa tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:39.234063 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f97edb3f-2e4e-46f8-9804-0a91a2fd6baa tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:39.234667 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f97edb3f-2e4e-46f8-9804-0a91a2fd6baa tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:39.235085 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f97edb3f-2e4e-46f8-9804-0a91a2fd6baa tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:39.380533 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-f97edb3f-2e4e-46f8-9804-0a91a2fd6baa tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:35:39.388270 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-f97edb3f-2e4e-46f8-9804-0a91a2fd6baa tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440" status: 200 len: 1265 microversion: 2.1 time: 0.175417 Aug 12 01:35:39.388831 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 452/900] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:35:39 2022] GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:35:40.413099 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-26dc5ee5-63b0-4f7e-9532-b079ba2495e3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:35:40.414150 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-26dc5ee5-63b0-4f7e-9532-b079ba2495e3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: 8c36d121-4610-4641-b12a-680daf8cf440] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:35:40.425259 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-26dc5ee5-63b0-4f7e-9532-b079ba2495e3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:40.427282 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-26dc5ee5-63b0-4f7e-9532-b079ba2495e3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:40.427282 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-26dc5ee5-63b0-4f7e-9532-b079ba2495e3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:40.428256 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-26dc5ee5-63b0-4f7e-9532-b079ba2495e3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:40.429108 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-26dc5ee5-63b0-4f7e-9532-b079ba2495e3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:40.429811 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-26dc5ee5-63b0-4f7e-9532-b079ba2495e3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:40.572772 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-26dc5ee5-63b0-4f7e-9532-b079ba2495e3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:35:40.584144 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-26dc5ee5-63b0-4f7e-9532-b079ba2495e3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440" status: 200 len: 1265 microversion: 2.1 time: 0.177352 Aug 12 01:35:40.584998 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 449/901] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:35:40 2022] GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:35:41.604802 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-428afd88-04ff-45fb-b22a-5080a7fa6505 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:35:41.605414 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-428afd88-04ff-45fb-b22a-5080a7fa6505 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: 8c36d121-4610-4641-b12a-680daf8cf440] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:35:41.612466 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-428afd88-04ff-45fb-b22a-5080a7fa6505 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:41.612941 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-428afd88-04ff-45fb-b22a-5080a7fa6505 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:41.613365 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-428afd88-04ff-45fb-b22a-5080a7fa6505 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:41.614046 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-428afd88-04ff-45fb-b22a-5080a7fa6505 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:41.614496 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-428afd88-04ff-45fb-b22a-5080a7fa6505 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:41.614899 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-428afd88-04ff-45fb-b22a-5080a7fa6505 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:41.750706 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-428afd88-04ff-45fb-b22a-5080a7fa6505 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:35:41.758566 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-428afd88-04ff-45fb-b22a-5080a7fa6505 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440" status: 200 len: 1265 microversion: 2.1 time: 0.157681 Aug 12 01:35:41.759113 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 453/902] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:35:41 2022] GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:35:42.783061 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-58ad8562-feb7-4d76-be99-79d7116771a5 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:35:42.783724 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-58ad8562-feb7-4d76-be99-79d7116771a5 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: 8c36d121-4610-4641-b12a-680daf8cf440] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:35:42.791212 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-58ad8562-feb7-4d76-be99-79d7116771a5 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:42.791783 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-58ad8562-feb7-4d76-be99-79d7116771a5 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:42.792257 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-58ad8562-feb7-4d76-be99-79d7116771a5 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:42.793014 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-58ad8562-feb7-4d76-be99-79d7116771a5 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:42.793509 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-58ad8562-feb7-4d76-be99-79d7116771a5 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:42.793976 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-58ad8562-feb7-4d76-be99-79d7116771a5 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:42.933983 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-58ad8562-feb7-4d76-be99-79d7116771a5 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:35:42.941925 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-58ad8562-feb7-4d76-be99-79d7116771a5 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440" status: 200 len: 1265 microversion: 2.1 time: 0.165248 Aug 12 01:35:42.942485 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 450/903] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:35:42 2022] GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:35:43.965790 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-7dad3936-2afb-4153-b0a3-9f9eff30df3a tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:35:43.966867 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-7dad3936-2afb-4153-b0a3-9f9eff30df3a tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: 8c36d121-4610-4641-b12a-680daf8cf440] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:35:43.977070 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7dad3936-2afb-4153-b0a3-9f9eff30df3a tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:43.977808 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7dad3936-2afb-4153-b0a3-9f9eff30df3a tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:43.978475 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7dad3936-2afb-4153-b0a3-9f9eff30df3a tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:43.979524 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7dad3936-2afb-4153-b0a3-9f9eff30df3a tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:43.980284 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7dad3936-2afb-4153-b0a3-9f9eff30df3a tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:43.980934 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7dad3936-2afb-4153-b0a3-9f9eff30df3a tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:44.117748 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-7dad3936-2afb-4153-b0a3-9f9eff30df3a tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:35:44.125446 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-7dad3936-2afb-4153-b0a3-9f9eff30df3a tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440" status: 200 len: 1265 microversion: 2.1 time: 0.165645 Aug 12 01:35:44.126007 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 454/904] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:35:43 2022] GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:35:45.146758 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-b6e3e8e0-5910-4b19-a65f-3e3e8ae7b80e tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:35:45.147324 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-b6e3e8e0-5910-4b19-a65f-3e3e8ae7b80e tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: 8c36d121-4610-4641-b12a-680daf8cf440] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:35:45.154059 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b6e3e8e0-5910-4b19-a65f-3e3e8ae7b80e tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:45.154530 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b6e3e8e0-5910-4b19-a65f-3e3e8ae7b80e tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:45.154957 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b6e3e8e0-5910-4b19-a65f-3e3e8ae7b80e tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:45.155735 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b6e3e8e0-5910-4b19-a65f-3e3e8ae7b80e tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:45.156210 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b6e3e8e0-5910-4b19-a65f-3e3e8ae7b80e tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:45.156680 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-b6e3e8e0-5910-4b19-a65f-3e3e8ae7b80e tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:45.297215 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-b6e3e8e0-5910-4b19-a65f-3e3e8ae7b80e tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:35:45.306073 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-b6e3e8e0-5910-4b19-a65f-3e3e8ae7b80e tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440" status: 200 len: 1451 microversion: 2.1 time: 0.163391 Aug 12 01:35:45.306631 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 451/905] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:35:45 2022] GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440 => generated 1451 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:35:45.336586 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-79407ad9-2351-408d-b3ea-41e30ad800f9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:35:45.337180 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-79407ad9-2351-408d-b3ea-41e30ad800f9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: 8c36d121-4610-4641-b12a-680daf8cf440] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:35:45.343689 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-79407ad9-2351-408d-b3ea-41e30ad800f9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:45.344165 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-79407ad9-2351-408d-b3ea-41e30ad800f9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:45.344597 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-79407ad9-2351-408d-b3ea-41e30ad800f9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:45.345356 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-79407ad9-2351-408d-b3ea-41e30ad800f9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:45.345805 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-79407ad9-2351-408d-b3ea-41e30ad800f9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:45.346207 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-79407ad9-2351-408d-b3ea-41e30ad800f9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:45.492044 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-79407ad9-2351-408d-b3ea-41e30ad800f9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:35:45.504902 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-79407ad9-2351-408d-b3ea-41e30ad800f9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440" status: 200 len: 1451 microversion: 2.1 time: 0.172153 Aug 12 01:35:45.505541 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 455/906] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:35:45 2022] GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440 => generated 1451 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:35:47.475901 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-37c13d85-70cf-4c51-b761-0c8d093813f8 req-d9bae552-0de3-48d9-aa03-007bd779fade service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c36d121-4610-4641-b12a-680daf8cf440", "tag": "1e026290-e0ea-4142-992c-806bce55dee6"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:35:47.487985 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-37c13d85-70cf-4c51-b761-0c8d093813f8 req-d9bae552-0de3-48d9-aa03-007bd779fade service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:35:47.488557 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-37c13d85-70cf-4c51-b761-0c8d093813f8 req-d9bae552-0de3-48d9-aa03-007bd779fade service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:35:47.489049 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-37c13d85-70cf-4c51-b761-0c8d093813f8 req-d9bae552-0de3-48d9-aa03-007bd779fade service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:35:47.502429 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-37c13d85-70cf-4c51-b761-0c8d093813f8 req-d9bae552-0de3-48d9-aa03-007bd779fade service nova] Creating event network-changed:1e026290-e0ea-4142-992c-806bce55dee6 for instance 8c36d121-4610-4641-b12a-680daf8cf440 on hv-cinder-78481 Aug 12 01:35:47.508760 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-37c13d85-70cf-4c51-b761-0c8d093813f8 req-d9bae552-0de3-48d9-aa03-007bd779fade service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176205 Aug 12 01:35:47.509836 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 452/907] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:36:03.866022 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_api:SELECT=28 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:03.866700 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell1:SELECT=68 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:03.870825 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-c747989a-6602-44aa-9898-a8044d1bcd74 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1745805459", "imageRef": "0d77ae04-91a5-4e2b-8817-72986618c549", "flavorRef": "452", "networks": [{"uuid": "18a5b222-203d-49ab-a389-b001de1bf635"}]}} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:36:03.931518 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.network.neutron [None req-c747989a-6602-44aa-9898-a8044d1bcd74 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] validate_networks() for [('18a5b222-203d-49ab-a389-b001de1bf635', None, None, None, None, None)] {{(pid=120786) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 01:36:04.360995 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-c747989a-6602-44aa-9898-a8044d1bcd74 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Flavor limits 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 01:36:04.361484 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-c747989a-6602-44aa-9898-a8044d1bcd74 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Image limits 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 01:36:04.362027 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-c747989a-6602-44aa-9898-a8044d1bcd74 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Flavor pref 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 01:36:04.362498 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-c747989a-6602-44aa-9898-a8044d1bcd74 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Image pref 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 01:36:04.363023 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-c747989a-6602-44aa-9898-a8044d1bcd74 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 01:36:04.372182 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c747989a-6602-44aa-9898-a8044d1bcd74 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:36:04.372752 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c747989a-6602-44aa-9898-a8044d1bcd74 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:36:04.373249 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c747989a-6602-44aa-9898-a8044d1bcd74 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:36:04.374038 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c747989a-6602-44aa-9898-a8044d1bcd74 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:36:04.374694 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c747989a-6602-44aa-9898-a8044d1bcd74 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:36:04.375116 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c747989a-6602-44aa-9898-a8044d1bcd74 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:36:04.393472 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.quota [None req-c747989a-6602-44aa-9898-a8044d1bcd74 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Getting quotas for project c325ffbf006f4c8fa8ce5f370a157c02. Resources: {'cores', 'ram', 'instances'} {{(pid=120786) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 01:36:04.397603 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.quota [None req-c747989a-6602-44aa-9898-a8044d1bcd74 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Getting quotas for user 83d94989669a458db647bd8344087efa and project c325ffbf006f4c8fa8ce5f370a157c02. Resources: {'cores', 'ram', 'instances'} {{(pid=120786) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 01:36:04.409547 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-c747989a-6602-44aa-9898-a8044d1bcd74 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Going to run 1 instances... {{(pid=120786) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 01:36:04.411907 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-c747989a-6602-44aa-9898-a8044d1bcd74 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: e26d8c14-0471-43d3-8649-4bced6a28d79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d77ae04-91a5-4e2b-8817-72986618c549',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120786) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 01:36:04.460182 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-c747989a-6602-44aa-9898-a8044d1bcd74 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.595054 Aug 12 01:36:04.461002 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 456/908] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 01:36:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 01:36:04.477337 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-12070f3c-e265-4782-92a4-c50c563934c2 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:36:04.478230 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-12070f3c-e265-4782-92a4-c50c563934c2 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: e26d8c14-0471-43d3-8649-4bced6a28d79] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:36:04.485952 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:04.486751 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell1:SELECT=73 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:04.574710 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-12070f3c-e265-4782-92a4-c50c563934c2 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d94989669a458db647bd8344087efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c325ffbf006f4c8fa8ce5f370a157c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:36:04.587156 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-12070f3c-e265-4782-92a4-c50c563934c2 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] 10.222.0.20 "GET /compute/v2.1/servers/e26d8c14-0471-43d3-8649-4bced6a28d79" status: 200 len: 1219 microversion: 2.1 time: 0.117887 Aug 12 01:36:04.588130 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 453/909] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:36:04 2022] GET /compute/v2.1/servers/e26d8c14-0471-43d3-8649-4bced6a28d79 => generated 1219 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:36:05.608103 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-46b0f935-9dc5-4e8d-8a45-f2ae45cab124 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:36:05.609228 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-46b0f935-9dc5-4e8d-8a45-f2ae45cab124 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: e26d8c14-0471-43d3-8649-4bced6a28d79] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:36:05.618038 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-46b0f935-9dc5-4e8d-8a45-f2ae45cab124 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:36:05.618983 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-46b0f935-9dc5-4e8d-8a45-f2ae45cab124 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:36:05.622512 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-46b0f935-9dc5-4e8d-8a45-f2ae45cab124 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:36:05.622512 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-46b0f935-9dc5-4e8d-8a45-f2ae45cab124 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:36:05.622512 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-46b0f935-9dc5-4e8d-8a45-f2ae45cab124 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:36:05.622512 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-46b0f935-9dc5-4e8d-8a45-f2ae45cab124 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:36:05.696456 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-46b0f935-9dc5-4e8d-8a45-f2ae45cab124 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d94989669a458db647bd8344087efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c325ffbf006f4c8fa8ce5f370a157c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:36:05.706855 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-46b0f935-9dc5-4e8d-8a45-f2ae45cab124 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] 10.222.0.20 "GET /compute/v2.1/servers/e26d8c14-0471-43d3-8649-4bced6a28d79" status: 200 len: 1277 microversion: 2.1 time: 0.103059 Aug 12 01:36:05.708044 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 457/910] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:36:05 2022] GET /compute/v2.1/servers/e26d8c14-0471-43d3-8649-4bced6a28d79 => generated 1277 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:36:06.728408 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-3adc9771-68af-486b-826b-8d22524e77ef tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:36:06.729702 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-3adc9771-68af-486b-826b-8d22524e77ef tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: e26d8c14-0471-43d3-8649-4bced6a28d79] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:36:06.737017 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3adc9771-68af-486b-826b-8d22524e77ef tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:36:06.737741 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3adc9771-68af-486b-826b-8d22524e77ef tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:36:06.738370 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3adc9771-68af-486b-826b-8d22524e77ef tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:36:06.739216 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3adc9771-68af-486b-826b-8d22524e77ef tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:36:06.739889 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3adc9771-68af-486b-826b-8d22524e77ef tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:36:06.740578 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3adc9771-68af-486b-826b-8d22524e77ef tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:36:06.894638 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-3adc9771-68af-486b-826b-8d22524e77ef tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d94989669a458db647bd8344087efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c325ffbf006f4c8fa8ce5f370a157c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:36:06.905706 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-3adc9771-68af-486b-826b-8d22524e77ef tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] 10.222.0.20 "GET /compute/v2.1/servers/e26d8c14-0471-43d3-8649-4bced6a28d79" status: 200 len: 1319 microversion: 2.1 time: 0.181091 Aug 12 01:36:06.906758 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 454/911] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:36:06 2022] GET /compute/v2.1/servers/e26d8c14-0471-43d3-8649-4bced6a28d79 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:36:06.937445 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-ba158f71-350c-4c68-af22-6b9cb54d4ccc req-a100e6d5-22bb-4a9e-994f-0500ba733e16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e26d8c14-0471-43d3-8649-4bced6a28d79", "tag": "2126a465-71c5-4b71-ad16-f601b4300b96"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:36:06.948270 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-ba158f71-350c-4c68-af22-6b9cb54d4ccc req-a100e6d5-22bb-4a9e-994f-0500ba733e16 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:36:06.948745 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-ba158f71-350c-4c68-af22-6b9cb54d4ccc req-a100e6d5-22bb-4a9e-994f-0500ba733e16 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:36:06.949340 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-ba158f71-350c-4c68-af22-6b9cb54d4ccc req-a100e6d5-22bb-4a9e-994f-0500ba733e16 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:36:06.961118 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-ba158f71-350c-4c68-af22-6b9cb54d4ccc req-a100e6d5-22bb-4a9e-994f-0500ba733e16 service nova] Creating event network-changed:2126a465-71c5-4b71-ad16-f601b4300b96 for instance e26d8c14-0471-43d3-8649-4bced6a28d79 on hv-cinder-78481 Aug 12 01:36:06.966503 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-ba158f71-350c-4c68-af22-6b9cb54d4ccc req-a100e6d5-22bb-4a9e-994f-0500ba733e16 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033040 Aug 12 01:36:06.967326 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 458/912] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 01:36:07.927292 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-0b4b1556-5607-4849-abf4-389921662f5b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:36:07.927950 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-0b4b1556-5607-4849-abf4-389921662f5b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: e26d8c14-0471-43d3-8649-4bced6a28d79] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:36:07.934024 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0b4b1556-5607-4849-abf4-389921662f5b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:36:07.934519 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0b4b1556-5607-4849-abf4-389921662f5b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:36:07.934946 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0b4b1556-5607-4849-abf4-389921662f5b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:36:07.935677 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0b4b1556-5607-4849-abf4-389921662f5b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:36:07.936113 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0b4b1556-5607-4849-abf4-389921662f5b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:36:07.936530 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-0b4b1556-5607-4849-abf4-389921662f5b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:36:08.070681 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-0b4b1556-5607-4849-abf4-389921662f5b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d94989669a458db647bd8344087efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c325ffbf006f4c8fa8ce5f370a157c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:36:08.078179 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-0b4b1556-5607-4849-abf4-389921662f5b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] 10.222.0.20 "GET /compute/v2.1/servers/e26d8c14-0471-43d3-8649-4bced6a28d79" status: 200 len: 1319 microversion: 2.1 time: 0.154974 Aug 12 01:36:08.078779 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 455/913] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:36:07 2022] GET /compute/v2.1/servers/e26d8c14-0471-43d3-8649-4bced6a28d79 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:36:09.100903 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-c95f5fe0-4745-478a-acb2-6fa34206f4d0 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:36:09.102487 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-c95f5fe0-4745-478a-acb2-6fa34206f4d0 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: e26d8c14-0471-43d3-8649-4bced6a28d79] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:36:09.110500 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c95f5fe0-4745-478a-acb2-6fa34206f4d0 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:36:09.110988 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c95f5fe0-4745-478a-acb2-6fa34206f4d0 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:36:09.111656 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c95f5fe0-4745-478a-acb2-6fa34206f4d0 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:36:09.112559 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c95f5fe0-4745-478a-acb2-6fa34206f4d0 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:36:09.113169 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c95f5fe0-4745-478a-acb2-6fa34206f4d0 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:36:09.113751 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c95f5fe0-4745-478a-acb2-6fa34206f4d0 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:36:09.273377 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-c95f5fe0-4745-478a-acb2-6fa34206f4d0 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d94989669a458db647bd8344087efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c325ffbf006f4c8fa8ce5f370a157c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:36:09.282748 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-c95f5fe0-4745-478a-acb2-6fa34206f4d0 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] 10.222.0.20 "GET /compute/v2.1/servers/e26d8c14-0471-43d3-8649-4bced6a28d79" status: 200 len: 1319 microversion: 2.1 time: 0.186198 Aug 12 01:36:09.283330 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 459/914] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:36:09 2022] GET /compute/v2.1/servers/e26d8c14-0471-43d3-8649-4bced6a28d79 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:36:10.305499 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-64f629f8-ee5f-4fc6-b0a6-6f5d5200e5c5 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:36:10.306151 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-64f629f8-ee5f-4fc6-b0a6-6f5d5200e5c5 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: e26d8c14-0471-43d3-8649-4bced6a28d79] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:36:10.313348 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-64f629f8-ee5f-4fc6-b0a6-6f5d5200e5c5 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:36:10.313842 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-64f629f8-ee5f-4fc6-b0a6-6f5d5200e5c5 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:36:10.314419 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-64f629f8-ee5f-4fc6-b0a6-6f5d5200e5c5 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:36:10.315307 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-64f629f8-ee5f-4fc6-b0a6-6f5d5200e5c5 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:36:10.315783 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-64f629f8-ee5f-4fc6-b0a6-6f5d5200e5c5 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:36:10.316211 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-64f629f8-ee5f-4fc6-b0a6-6f5d5200e5c5 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:36:10.510835 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-64f629f8-ee5f-4fc6-b0a6-6f5d5200e5c5 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d94989669a458db647bd8344087efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c325ffbf006f4c8fa8ce5f370a157c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:36:10.520948 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-64f629f8-ee5f-4fc6-b0a6-6f5d5200e5c5 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] 10.222.0.20 "GET /compute/v2.1/servers/e26d8c14-0471-43d3-8649-4bced6a28d79" status: 200 len: 1319 microversion: 2.1 time: 0.221112 Aug 12 01:36:10.521599 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 456/915] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:36:10 2022] GET /compute/v2.1/servers/e26d8c14-0471-43d3-8649-4bced6a28d79 => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:36:11.556356 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-458395de-d5b9-4bca-8978-37194b19d75a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:36:11.557608 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-458395de-d5b9-4bca-8978-37194b19d75a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: e26d8c14-0471-43d3-8649-4bced6a28d79] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:36:11.564413 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-458395de-d5b9-4bca-8978-37194b19d75a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:36:11.565149 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-458395de-d5b9-4bca-8978-37194b19d75a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:36:11.565884 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-458395de-d5b9-4bca-8978-37194b19d75a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:36:11.566862 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-458395de-d5b9-4bca-8978-37194b19d75a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:36:11.567452 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-458395de-d5b9-4bca-8978-37194b19d75a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:36:11.568070 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-458395de-d5b9-4bca-8978-37194b19d75a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:36:11.703695 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-bd180283-6d29-43be-be14-061f22c5cc4c req-137644b2-e039-4b7b-b997-e67a6ebc34df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e26d8c14-0471-43d3-8649-4bced6a28d79", "name": "network-vif-plugged", "status": "completed", "tag": "2126a465-71c5-4b71-ad16-f601b4300b96"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:36:11.723266 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-bd180283-6d29-43be-be14-061f22c5cc4c req-137644b2-e039-4b7b-b997-e67a6ebc34df service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:36:11.724091 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-bd180283-6d29-43be-be14-061f22c5cc4c req-137644b2-e039-4b7b-b997-e67a6ebc34df service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:36:11.728113 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-458395de-d5b9-4bca-8978-37194b19d75a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d94989669a458db647bd8344087efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c325ffbf006f4c8fa8ce5f370a157c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:36:11.731511 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-bd180283-6d29-43be-be14-061f22c5cc4c req-137644b2-e039-4b7b-b997-e67a6ebc34df service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:36:11.740166 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-458395de-d5b9-4bca-8978-37194b19d75a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] 10.222.0.20 "GET /compute/v2.1/servers/e26d8c14-0471-43d3-8649-4bced6a28d79" status: 200 len: 1319 microversion: 2.1 time: 0.200360 Aug 12 01:36:11.741206 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 460/916] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:36:11 2022] GET /compute/v2.1/servers/e26d8c14-0471-43d3-8649-4bced6a28d79 => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:36:11.750739 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-bd180283-6d29-43be-be14-061f22c5cc4c req-137644b2-e039-4b7b-b997-e67a6ebc34df service nova] Creating event network-vif-plugged:2126a465-71c5-4b71-ad16-f601b4300b96 for instance e26d8c14-0471-43d3-8649-4bced6a28d79 on hv-cinder-78481 Aug 12 01:36:11.757571 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-bd180283-6d29-43be-be14-061f22c5cc4c req-137644b2-e039-4b7b-b997-e67a6ebc34df service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059154 Aug 12 01:36:11.758790 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 457/917] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:36:12.762816 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-d72cc68a-880a-4659-9cd2-b423d2a9bd8b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:36:12.763433 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-d72cc68a-880a-4659-9cd2-b423d2a9bd8b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: e26d8c14-0471-43d3-8649-4bced6a28d79] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:36:12.769891 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d72cc68a-880a-4659-9cd2-b423d2a9bd8b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:36:12.770365 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d72cc68a-880a-4659-9cd2-b423d2a9bd8b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:36:12.771099 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d72cc68a-880a-4659-9cd2-b423d2a9bd8b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:36:12.771824 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d72cc68a-880a-4659-9cd2-b423d2a9bd8b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:36:12.772270 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d72cc68a-880a-4659-9cd2-b423d2a9bd8b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:36:12.772684 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d72cc68a-880a-4659-9cd2-b423d2a9bd8b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:36:12.912810 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-d72cc68a-880a-4659-9cd2-b423d2a9bd8b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d94989669a458db647bd8344087efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c325ffbf006f4c8fa8ce5f370a157c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:36:12.922886 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-d72cc68a-880a-4659-9cd2-b423d2a9bd8b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] 10.222.0.20 "GET /compute/v2.1/servers/e26d8c14-0471-43d3-8649-4bced6a28d79" status: 200 len: 1319 microversion: 2.1 time: 0.163835 Aug 12 01:36:12.931295 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 461/918] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:36:12 2022] GET /compute/v2.1/servers/e26d8c14-0471-43d3-8649-4bced6a28d79 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:36:13.943818 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-baf69890-124f-4e00-bcd8-28e974af5160 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:36:13.944497 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-baf69890-124f-4e00-bcd8-28e974af5160 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: e26d8c14-0471-43d3-8649-4bced6a28d79] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:36:13.951253 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-baf69890-124f-4e00-bcd8-28e974af5160 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:36:13.951765 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-baf69890-124f-4e00-bcd8-28e974af5160 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:36:13.952192 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-baf69890-124f-4e00-bcd8-28e974af5160 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:36:13.952868 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-baf69890-124f-4e00-bcd8-28e974af5160 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:36:13.953314 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-baf69890-124f-4e00-bcd8-28e974af5160 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:36:13.953724 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-baf69890-124f-4e00-bcd8-28e974af5160 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:36:14.096263 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-baf69890-124f-4e00-bcd8-28e974af5160 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d94989669a458db647bd8344087efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c325ffbf006f4c8fa8ce5f370a157c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:36:14.103929 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-baf69890-124f-4e00-bcd8-28e974af5160 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] 10.222.0.20 "GET /compute/v2.1/servers/e26d8c14-0471-43d3-8649-4bced6a28d79" status: 200 len: 1508 microversion: 2.1 time: 0.164444 Aug 12 01:36:14.104484 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 458/919] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:36:13 2022] GET /compute/v2.1/servers/e26d8c14-0471-43d3-8649-4bced6a28d79 => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:36:34.758818 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-853b2422-6940-4733-a521-9eac83b9ba63 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aad59890-da2b-404d-8849-1c491aa69f77", "device": "/dev/sdb"}} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:36:34.761914 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-853b2422-6940-4733-a521-9eac83b9ba63 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: e26d8c14-0471-43d3-8649-4bced6a28d79] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:36:34.763918 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell0:SELECT=2 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:34.764540 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell0:SELECT=6 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:34.765212 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:34.765815 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell1:SELECT=28 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:34.771880 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-853b2422-6940-4733-a521-9eac83b9ba63 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:36:34.772358 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-853b2422-6940-4733-a521-9eac83b9ba63 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:36:34.772787 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-853b2422-6940-4733-a521-9eac83b9ba63 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:36:34.773477 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-853b2422-6940-4733-a521-9eac83b9ba63 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:36:34.773922 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-853b2422-6940-4733-a521-9eac83b9ba63 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:36:34.774431 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-853b2422-6940-4733-a521-9eac83b9ba63 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:36:37.430586 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-853b2422-6940-4733-a521-9eac83b9ba63 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] 10.222.0.20 "POST /compute/v2.1/servers/e26d8c14-0471-43d3-8649-4bced6a28d79/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.675757 Aug 12 01:36:37.431224 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 462/920] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Aug 12 01:36:34 2022] POST /compute/v2.1/servers/e26d8c14-0471-43d3-8649-4bced6a28d79/os-volume_attachments => generated 194 bytes in 2677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:37:13.011708 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell0:SELECT=2 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:37:13.012444 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_api:SELECT=14 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:37:13.013091 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell1:SELECT=26 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:37:13.017631 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-723ef9f3-f7e0-42bf-8bf6-c22bfc2c2a04 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:13.018162 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-723ef9f3-f7e0-42bf-8bf6-c22bfc2c2a04 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: e26d8c14-0471-43d3-8649-4bced6a28d79] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:13.025876 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-723ef9f3-f7e0-42bf-8bf6-c22bfc2c2a04 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:13.026468 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-723ef9f3-f7e0-42bf-8bf6-c22bfc2c2a04 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:13.026931 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-723ef9f3-f7e0-42bf-8bf6-c22bfc2c2a04 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:13.027627 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-723ef9f3-f7e0-42bf-8bf6-c22bfc2c2a04 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:13.028069 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-723ef9f3-f7e0-42bf-8bf6-c22bfc2c2a04 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:13.028521 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-723ef9f3-f7e0-42bf-8bf6-c22bfc2c2a04 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:13.111354 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.objects.instance [None req-723ef9f3-f7e0-42bf-8bf6-c22bfc2c2a04 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lazy-loading 'services' on Instance uuid e26d8c14-0471-43d3-8649-4bced6a28d79 {{(pid=120785) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 01:37:13.190875 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-723ef9f3-f7e0-42bf-8bf6-c22bfc2c2a04 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e26d8c14-0471-43d3-8649-4bced6a28d79/os-volume_attachments/aad59890-da2b-404d-8849-1c491aa69f77" status: 202 len: 0 microversion: 2.1 time: 0.180035 Aug 12 01:37:13.191615 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 459/921] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Aug 12 01:37:13 2022] DELETE /compute/v2.1/servers/e26d8c14-0471-43d3-8649-4bced6a28d79/os-volume_attachments/aad59890-da2b-404d-8849-1c491aa69f77 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 01:37:14.319659 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_api:SELECT=2 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:37:14.320615 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:37:14.326341 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-64aff064-8bf3-4bc4-849d-d4840e4220f1 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:14.327135 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-64aff064-8bf3-4bc4-849d-d4840e4220f1 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: e26d8c14-0471-43d3-8649-4bced6a28d79] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:14.336182 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-64aff064-8bf3-4bc4-849d-d4840e4220f1 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:14.336619 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-64aff064-8bf3-4bc4-849d-d4840e4220f1 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:14.337043 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-64aff064-8bf3-4bc4-849d-d4840e4220f1 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:14.337773 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-64aff064-8bf3-4bc4-849d-d4840e4220f1 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:14.338225 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-64aff064-8bf3-4bc4-849d-d4840e4220f1 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:14.338721 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-64aff064-8bf3-4bc4-849d-d4840e4220f1 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:14.365408 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-64aff064-8bf3-4bc4-849d-d4840e4220f1 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: e26d8c14-0471-43d3-8649-4bced6a28d79] Going to try to terminate instance {{(pid=120786) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 01:37:14.447101 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-64aff064-8bf3-4bc4-849d-d4840e4220f1 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e26d8c14-0471-43d3-8649-4bced6a28d79" status: 204 len: 0 microversion: 2.1 time: 0.128922 Aug 12 01:37:14.447716 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 463/922] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 01:37:14 2022] DELETE /compute/v2.1/servers/e26d8c14-0471-43d3-8649-4bced6a28d79 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 01:37:14.456637 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-adf81df1-927b-41d4-84b6-818a80e1859b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:14.457347 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-adf81df1-927b-41d4-84b6-818a80e1859b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: e26d8c14-0471-43d3-8649-4bced6a28d79] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:14.464396 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-adf81df1-927b-41d4-84b6-818a80e1859b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:14.464893 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-adf81df1-927b-41d4-84b6-818a80e1859b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:14.465398 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-adf81df1-927b-41d4-84b6-818a80e1859b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:14.466036 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-adf81df1-927b-41d4-84b6-818a80e1859b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:14.466483 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-adf81df1-927b-41d4-84b6-818a80e1859b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:14.466904 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-adf81df1-927b-41d4-84b6-818a80e1859b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:14.602864 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-adf81df1-927b-41d4-84b6-818a80e1859b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d94989669a458db647bd8344087efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c325ffbf006f4c8fa8ce5f370a157c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:37:14.611192 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-adf81df1-927b-41d4-84b6-818a80e1859b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] 10.222.0.20 "GET /compute/v2.1/servers/e26d8c14-0471-43d3-8649-4bced6a28d79" status: 200 len: 1514 microversion: 2.1 time: 0.158701 Aug 12 01:37:14.611799 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 460/923] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:37:14 2022] GET /compute/v2.1/servers/e26d8c14-0471-43d3-8649-4bced6a28d79 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:37:15.632743 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-d5d0361d-3ff9-445b-9f8f-77cdf2ba2174 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:15.633372 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-d5d0361d-3ff9-445b-9f8f-77cdf2ba2174 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: e26d8c14-0471-43d3-8649-4bced6a28d79] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:15.640184 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d5d0361d-3ff9-445b-9f8f-77cdf2ba2174 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:15.640692 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d5d0361d-3ff9-445b-9f8f-77cdf2ba2174 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:15.641143 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d5d0361d-3ff9-445b-9f8f-77cdf2ba2174 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:15.641842 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d5d0361d-3ff9-445b-9f8f-77cdf2ba2174 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:15.642290 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d5d0361d-3ff9-445b-9f8f-77cdf2ba2174 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:15.642710 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-d5d0361d-3ff9-445b-9f8f-77cdf2ba2174 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:15.775575 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-d5d0361d-3ff9-445b-9f8f-77cdf2ba2174 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d94989669a458db647bd8344087efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c325ffbf006f4c8fa8ce5f370a157c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:37:15.783655 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-d5d0361d-3ff9-445b-9f8f-77cdf2ba2174 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] 10.222.0.20 "GET /compute/v2.1/servers/e26d8c14-0471-43d3-8649-4bced6a28d79" status: 200 len: 1514 microversion: 2.1 time: 0.155217 Aug 12 01:37:15.784218 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 464/924] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:37:15 2022] GET /compute/v2.1/servers/e26d8c14-0471-43d3-8649-4bced6a28d79 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:37:16.699379 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-dc19a716-39f9-4874-a17c-cb0e423426c1 req-26fca314-a482-4c2e-a6f3-ef1a1a40fbb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e26d8c14-0471-43d3-8649-4bced6a28d79", "name": "network-vif-deleted", "tag": "2126a465-71c5-4b71-ad16-f601b4300b96"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:37:16.711345 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-dc19a716-39f9-4874-a17c-cb0e423426c1 req-26fca314-a482-4c2e-a6f3-ef1a1a40fbb4 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:16.712145 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-dc19a716-39f9-4874-a17c-cb0e423426c1 req-26fca314-a482-4c2e-a6f3-ef1a1a40fbb4 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:16.712580 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-dc19a716-39f9-4874-a17c-cb0e423426c1 req-26fca314-a482-4c2e-a6f3-ef1a1a40fbb4 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:16.724784 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-dc19a716-39f9-4874-a17c-cb0e423426c1 req-26fca314-a482-4c2e-a6f3-ef1a1a40fbb4 service nova] Creating event network-vif-deleted:2126a465-71c5-4b71-ad16-f601b4300b96 for instance e26d8c14-0471-43d3-8649-4bced6a28d79 on hv-cinder-78481 Aug 12 01:37:16.730710 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-dc19a716-39f9-4874-a17c-cb0e423426c1 req-26fca314-a482-4c2e-a6f3-ef1a1a40fbb4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035271 Aug 12 01:37:16.731302 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 461/925] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:37:16.806126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-100b879b-c42d-4df1-a364-da0336b0249a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:16.806725 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-100b879b-c42d-4df1-a364-da0336b0249a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: e26d8c14-0471-43d3-8649-4bced6a28d79] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:16.813763 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-100b879b-c42d-4df1-a364-da0336b0249a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:16.814170 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-100b879b-c42d-4df1-a364-da0336b0249a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:16.814604 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-100b879b-c42d-4df1-a364-da0336b0249a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:16.815429 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-100b879b-c42d-4df1-a364-da0336b0249a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:16.815818 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-100b879b-c42d-4df1-a364-da0336b0249a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:16.816245 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-100b879b-c42d-4df1-a364-da0336b0249a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:16.848934 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-100b879b-c42d-4df1-a364-da0336b0249a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:16.849408 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-100b879b-c42d-4df1-a364-da0336b0249a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:16.849841 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-100b879b-c42d-4df1-a364-da0336b0249a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:16.850285 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.objects.instance [None req-100b879b-c42d-4df1-a364-da0336b0249a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lazy-loading 'fault' on Instance uuid e26d8c14-0471-43d3-8649-4bced6a28d79 {{(pid=120786) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 01:37:16.890202 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-100b879b-c42d-4df1-a364-da0336b0249a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d94989669a458db647bd8344087efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c325ffbf006f4c8fa8ce5f370a157c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:37:16.897810 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-100b879b-c42d-4df1-a364-da0336b0249a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] 10.222.0.20 "GET /compute/v2.1/servers/e26d8c14-0471-43d3-8649-4bced6a28d79" status: 200 len: 1309 microversion: 2.1 time: 0.096006 Aug 12 01:37:16.898377 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 465/926] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:37:16 2022] GET /compute/v2.1/servers/e26d8c14-0471-43d3-8649-4bced6a28d79 => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:37:17.923714 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-6bf629fc-2c59-4c51-89a6-b1f1c6c24a6d tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:17.925198 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-6bf629fc-2c59-4c51-89a6-b1f1c6c24a6d tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: e26d8c14-0471-43d3-8649-4bced6a28d79] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:17.934937 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6bf629fc-2c59-4c51-89a6-b1f1c6c24a6d tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:17.935415 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6bf629fc-2c59-4c51-89a6-b1f1c6c24a6d tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:17.935878 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6bf629fc-2c59-4c51-89a6-b1f1c6c24a6d tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:17.936562 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6bf629fc-2c59-4c51-89a6-b1f1c6c24a6d tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:17.937007 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6bf629fc-2c59-4c51-89a6-b1f1c6c24a6d tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:17.937426 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6bf629fc-2c59-4c51-89a6-b1f1c6c24a6d tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:17.950727 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.wsgi [None req-6bf629fc-2c59-4c51-89a6-b1f1c6c24a6d tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] HTTP exception thrown: Instance e26d8c14-0471-43d3-8649-4bced6a28d79 could not be found. Aug 12 01:37:17.952369 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-6bf629fc-2c59-4c51-89a6-b1f1c6c24a6d tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Request method failure captured: Aug 12 01:37:17.952369 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: request: GET /compute/v2.1/servers/e26d8c14-0471-43d3-8649-4bced6a28d79 HTTP/1.1 Aug 12 01:37:17.952369 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept: application/json Aug 12 01:37:17.952369 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept-Encoding: identity Aug 12 01:37:17.952369 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Connection: close Aug 12 01:37:17.952369 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Length: 0 Aug 12 01:37:17.952369 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Type: application/json Aug 12 01:37:17.952369 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Host: 10.222.0.20 Aug 12 01:37:17.952369 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Openstack-System-Scope: None Aug 12 01:37:17.952369 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: User-Agent: python-urllib3/1.26.11 Aug 12 01:37:17.952369 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Auth-Token: gAAAAABi9a6C72nVRYhLMvm41KnczxSW7aSbVSaDWldASgVKDW8lGnE1dBtRHl7L5fGjoR5qUTbnxmjYZHmDAbYeVNgUr_cWA4CaRWKAwztIx27WnJ9IdxuKZBqMCCz6YM3p8FLc7tkTpqfZlpfHPD03Bco59RUabi-kipAsFsKS2WRKYZQkawA Aug 12 01:37:17.952369 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Id: None Aug 12 01:37:17.952369 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Name: None Aug 12 01:37:17.952369 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Identity-Status: Confirmed Aug 12 01:37:17.952369 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Is-Admin-Project: True Aug 12 01:37:17.952369 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Id: default Aug 12 01:37:17.952369 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Name: Default Aug 12 01:37:17.952369 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Id: c325ffbf006f4c8fa8ce5f370a157c02 Aug 12 01:37:17.952369 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1025844362 Aug 12 01:37:17.952369 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Role: member,reader Aug 12 01:37:17.952369 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Roles: member,reader Aug 12 01:37:17.954119 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c325ffbf006f4c8fa8ce5f370a157c02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c325ffbf006f4c8fa8ce5f370a157c02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c325ffbf006f4c8fa8ce5f370a157c02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c325ffbf006f4c8fa8ce5f370a157c02"}]}] Aug 12 01:37:17.954119 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant: tempest-VolumesSnapshotTestJSON-1025844362 Aug 12 01:37:17.954119 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Id: c325ffbf006f4c8fa8ce5f370a157c02 Aug 12 01:37:17.954119 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1025844362 Aug 12 01:37:17.954119 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User: tempest-VolumesSnapshotTestJSON-1025844362-project Aug 12 01:37:17.954119 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Id: default Aug 12 01:37:17.954119 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Name: Default Aug 12 01:37:17.954119 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Id: 83d94989669a458db647bd8344087efa Aug 12 01:37:17.954119 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Name: tempest-VolumesSnapshotTestJSON-1025844362-project Aug 12 01:37:17.954119 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: method: > Aug 12 01:37:17.954119 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: exception: Instance e26d8c14-0471-43d3-8649-4bced6a28d79 could not be found. Aug 12 01:37:17.954119 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: action_args: {'id': 'e26d8c14-0471-43d3-8649-4bced6a28d79'} Aug 12 01:37:17.954977 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:37:17.954977 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:37:17.954977 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:37:17.954977 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:37:17.954977 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:37:17.954977 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:37:17.954977 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:37:17.954977 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:37:17.954977 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:37:17.954977 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:37:17.954977 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e26d8c14-0471-43d3-8649-4bced6a28d79 could not be found. Aug 12 01:37:17.954977 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:37:17.954977 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:37:17.954977 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:37:17.954977 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:37:17.954977 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:37:17.954977 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:37:17.954977 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:37:17.954977 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:37:17.954977 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:37:17.956373 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:37:17.956373 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 01:37:17.956373 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 01:37:17.956373 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:37:17.956373 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:37:17.956373 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:37:17.956373 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:37:17.956373 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e26d8c14-0471-43d3-8649-4bced6a28d79 could not be found. Aug 12 01:37:17.956373 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:37:17.956373 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:37:17.956373 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:37:17.956373 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:37:17.956373 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:37:17.956373 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:37:17.956373 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:37:17.956373 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:37:17.956373 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e26d8c14-0471-43d3-8649-4bced6a28d79 could not be found. Aug 12 01:37:17.956373 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:37:17.957893 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-6bf629fc-2c59-4c51-89a6-b1f1c6c24a6d tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Returning 404 to user: Instance e26d8c14-0471-43d3-8649-4bced6a28d79 could not be found. {{(pid=120785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:37:17.957893 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-6bf629fc-2c59-4c51-89a6-b1f1c6c24a6d tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] 10.222.0.20 "GET /compute/v2.1/servers/e26d8c14-0471-43d3-8649-4bced6a28d79" status: 404 len: 111 microversion: 2.1 time: 0.037042 Aug 12 01:37:17.957893 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 462/927] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:37:17 2022] GET /compute/v2.1/servers/e26d8c14-0471-43d3-8649-4bced6a28d79 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:37:27.942580 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-94234148-439c-42e8-83e8-6b22f0f3628a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1040688393", "imageRef": "0d77ae04-91a5-4e2b-8817-72986618c549", "flavorRef": "452", "networks": [{"uuid": "18a5b222-203d-49ab-a389-b001de1bf635"}]}} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:37:27.950718 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:37:27.951362 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:37:27.997599 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.network.neutron [None req-94234148-439c-42e8-83e8-6b22f0f3628a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] validate_networks() for [('18a5b222-203d-49ab-a389-b001de1bf635', None, None, None, None, None)] {{(pid=120786) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 01:37:28.360913 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-94234148-439c-42e8-83e8-6b22f0f3628a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Flavor limits 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 01:37:28.361428 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-94234148-439c-42e8-83e8-6b22f0f3628a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Image limits 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 01:37:28.361915 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-94234148-439c-42e8-83e8-6b22f0f3628a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Flavor pref 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 01:37:28.362425 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-94234148-439c-42e8-83e8-6b22f0f3628a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Image pref 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 01:37:28.362819 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-94234148-439c-42e8-83e8-6b22f0f3628a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 01:37:28.372424 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-94234148-439c-42e8-83e8-6b22f0f3628a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:28.373026 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-94234148-439c-42e8-83e8-6b22f0f3628a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:28.373452 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-94234148-439c-42e8-83e8-6b22f0f3628a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:28.374494 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-94234148-439c-42e8-83e8-6b22f0f3628a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:28.375069 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-94234148-439c-42e8-83e8-6b22f0f3628a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:28.375485 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-94234148-439c-42e8-83e8-6b22f0f3628a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:28.397456 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.quota [None req-94234148-439c-42e8-83e8-6b22f0f3628a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Getting quotas for project c325ffbf006f4c8fa8ce5f370a157c02. Resources: {'cores', 'ram', 'instances'} {{(pid=120786) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 01:37:28.402136 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.quota [None req-94234148-439c-42e8-83e8-6b22f0f3628a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Getting quotas for user 83d94989669a458db647bd8344087efa and project c325ffbf006f4c8fa8ce5f370a157c02. Resources: {'cores', 'ram', 'instances'} {{(pid=120786) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 01:37:28.413263 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-94234148-439c-42e8-83e8-6b22f0f3628a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Going to run 1 instances... {{(pid=120786) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 01:37:28.415544 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-94234148-439c-42e8-83e8-6b22f0f3628a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: 691b5aff-f98b-4d30-86b9-70c933c401b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d77ae04-91a5-4e2b-8817-72986618c549',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120786) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 01:37:28.463147 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-94234148-439c-42e8-83e8-6b22f0f3628a tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.524502 Aug 12 01:37:28.463828 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 466/928] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 01:37:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 01:37:28.474638 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-828446a0-5944-4f0c-b14b-daee9d214733 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:28.475318 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-828446a0-5944-4f0c-b14b-daee9d214733 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: 691b5aff-f98b-4d30-86b9-70c933c401b9] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:28.477944 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_api:SELECT=8 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:37:28.478757 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:37:28.536495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-828446a0-5944-4f0c-b14b-daee9d214733 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d94989669a458db647bd8344087efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c325ffbf006f4c8fa8ce5f370a157c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:37:28.543886 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-828446a0-5944-4f0c-b14b-daee9d214733 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] 10.222.0.20 "GET /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9" status: 200 len: 1219 microversion: 2.1 time: 0.073096 Aug 12 01:37:28.544438 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 463/929] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:37:28 2022] GET /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9 => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:37:29.565542 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-5c17c89f-a8b7-4db8-9cc3-bfe281de555c tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:29.566172 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-5c17c89f-a8b7-4db8-9cc3-bfe281de555c tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: 691b5aff-f98b-4d30-86b9-70c933c401b9] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:29.618261 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-5c17c89f-a8b7-4db8-9cc3-bfe281de555c tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d94989669a458db647bd8344087efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c325ffbf006f4c8fa8ce5f370a157c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:37:29.625298 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-5c17c89f-a8b7-4db8-9cc3-bfe281de555c tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] 10.222.0.20 "GET /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9" status: 200 len: 1219 microversion: 2.1 time: 0.063924 Aug 12 01:37:29.625877 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 467/930] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:37:29 2022] GET /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9 => generated 1219 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:37:30.646107 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-5a5ef02c-610f-4807-8bcc-12931eda31b9 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:30.646689 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-5a5ef02c-610f-4807-8bcc-12931eda31b9 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: 691b5aff-f98b-4d30-86b9-70c933c401b9] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:30.701548 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-5a5ef02c-610f-4807-8bcc-12931eda31b9 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d94989669a458db647bd8344087efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c325ffbf006f4c8fa8ce5f370a157c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:37:30.708274 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-5a5ef02c-610f-4807-8bcc-12931eda31b9 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] 10.222.0.20 "GET /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9" status: 200 len: 1219 microversion: 2.1 time: 0.066119 Aug 12 01:37:30.709330 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 464/931] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:37:30 2022] GET /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:37:31.730653 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-65715648-c747-4cbc-8445-06a68558a701 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:31.731316 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-65715648-c747-4cbc-8445-06a68558a701 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: 691b5aff-f98b-4d30-86b9-70c933c401b9] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:31.785693 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-65715648-c747-4cbc-8445-06a68558a701 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d94989669a458db647bd8344087efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c325ffbf006f4c8fa8ce5f370a157c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:37:31.793284 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-65715648-c747-4cbc-8445-06a68558a701 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] 10.222.0.20 "GET /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9" status: 200 len: 1219 microversion: 2.1 time: 0.066772 Aug 12 01:37:31.793831 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 468/932] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:37:31 2022] GET /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:37:32.814558 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-f44da92f-552b-45d0-b63c-9cb8cf1dc03b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:32.815177 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-f44da92f-552b-45d0-b63c-9cb8cf1dc03b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: 691b5aff-f98b-4d30-86b9-70c933c401b9] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:32.821997 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f44da92f-552b-45d0-b63c-9cb8cf1dc03b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:32.822615 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f44da92f-552b-45d0-b63c-9cb8cf1dc03b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:32.823043 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f44da92f-552b-45d0-b63c-9cb8cf1dc03b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:32.823758 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f44da92f-552b-45d0-b63c-9cb8cf1dc03b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:32.824202 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f44da92f-552b-45d0-b63c-9cb8cf1dc03b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:32.824612 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f44da92f-552b-45d0-b63c-9cb8cf1dc03b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:32.894938 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-f44da92f-552b-45d0-b63c-9cb8cf1dc03b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d94989669a458db647bd8344087efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c325ffbf006f4c8fa8ce5f370a157c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:37:32.902859 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-f44da92f-552b-45d0-b63c-9cb8cf1dc03b tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] 10.222.0.20 "GET /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9" status: 200 len: 1223 microversion: 2.1 time: 0.092261 Aug 12 01:37:32.903413 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 465/933] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:37:32 2022] GET /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9 => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:37:33.463485 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-e817efbc-035a-403d-b1b7-1593f0b5ac25 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2024512492", "imageRef": "0d77ae04-91a5-4e2b-8817-72986618c549", "flavorRef": "452"}} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:37:33.524615 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.network.neutron [None req-e817efbc-035a-403d-b1b7-1593f0b5ac25 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] validate_networks() for None {{(pid=120786) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 01:37:33.803496 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-e817efbc-035a-403d-b1b7-1593f0b5ac25 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Flavor limits 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 01:37:33.803961 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-e817efbc-035a-403d-b1b7-1593f0b5ac25 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Image limits 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 01:37:33.804396 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-e817efbc-035a-403d-b1b7-1593f0b5ac25 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Flavor pref 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 01:37:33.804988 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-e817efbc-035a-403d-b1b7-1593f0b5ac25 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Image pref 0:0:0 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 01:37:33.805416 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.virt.hardware [None req-e817efbc-035a-403d-b1b7-1593f0b5ac25 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120786) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 01:37:33.816090 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e817efbc-035a-403d-b1b7-1593f0b5ac25 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:33.816569 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e817efbc-035a-403d-b1b7-1593f0b5ac25 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:33.817001 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e817efbc-035a-403d-b1b7-1593f0b5ac25 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:33.817722 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e817efbc-035a-403d-b1b7-1593f0b5ac25 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:33.818168 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e817efbc-035a-403d-b1b7-1593f0b5ac25 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:33.818584 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e817efbc-035a-403d-b1b7-1593f0b5ac25 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:33.835659 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.quota [None req-e817efbc-035a-403d-b1b7-1593f0b5ac25 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Getting quotas for project 5fab5e5f4de84221a00719892a04e7f8. Resources: {'cores', 'ram', 'instances'} {{(pid=120786) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 01:37:33.839550 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.quota [None req-e817efbc-035a-403d-b1b7-1593f0b5ac25 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Getting quotas for user 8d1704db27ab4c879a926cdf0bf66457 and project 5fab5e5f4de84221a00719892a04e7f8. Resources: {'cores', 'ram', 'instances'} {{(pid=120786) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 01:37:33.850373 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-e817efbc-035a-403d-b1b7-1593f0b5ac25 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Going to run 1 instances... {{(pid=120786) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 01:37:33.852589 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-e817efbc-035a-403d-b1b7-1593f0b5ac25 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] [instance: 91cd8600-9e0f-4e1b-946c-fca3bd75ff1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d77ae04-91a5-4e2b-8817-72986618c549',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120786) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 01:37:33.896651 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-e817efbc-035a-403d-b1b7-1593f0b5ac25 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.437128 Aug 12 01:37:33.897299 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 469/934] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 01:37:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 438 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 01:37:33.908188 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-facb6068-98de-4cdd-a1d8-1fb8042922a5 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:33.909596 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-facb6068-98de-4cdd-a1d8-1fb8042922a5 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] [instance: 91cd8600-9e0f-4e1b-946c-fca3bd75ff1e] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:33.923397 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-c35999ee-30aa-46b2-8aff-f4d2fbdf000d tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:33.924713 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-c35999ee-30aa-46b2-8aff-f4d2fbdf000d tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: 691b5aff-f98b-4d30-86b9-70c933c401b9] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:33.931831 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c35999ee-30aa-46b2-8aff-f4d2fbdf000d tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:33.932377 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c35999ee-30aa-46b2-8aff-f4d2fbdf000d tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:33.932805 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c35999ee-30aa-46b2-8aff-f4d2fbdf000d tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:33.933891 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c35999ee-30aa-46b2-8aff-f4d2fbdf000d tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:33.934403 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c35999ee-30aa-46b2-8aff-f4d2fbdf000d tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:33.935125 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c35999ee-30aa-46b2-8aff-f4d2fbdf000d tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:34.001590 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-facb6068-98de-4cdd-a1d8-1fb8042922a5 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1704db27ab4c879a926cdf0bf66457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fab5e5f4de84221a00719892a04e7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:37:34.008480 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-facb6068-98de-4cdd-a1d8-1fb8042922a5 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] 10.222.0.20 "GET /compute/v2.1/servers/91cd8600-9e0f-4e1b-946c-fca3bd75ff1e" status: 200 len: 1215 microversion: 2.1 time: 0.104076 Aug 12 01:37:34.010114 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 466/935] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:37:33 2022] GET /compute/v2.1/servers/91cd8600-9e0f-4e1b-946c-fca3bd75ff1e => generated 1215 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:37:34.025375 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-c35999ee-30aa-46b2-8aff-f4d2fbdf000d tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d94989669a458db647bd8344087efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c325ffbf006f4c8fa8ce5f370a157c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:37:34.033602 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-c35999ee-30aa-46b2-8aff-f4d2fbdf000d tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] 10.222.0.20 "GET /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9" status: 200 len: 1277 microversion: 2.1 time: 0.114346 Aug 12 01:37:34.034387 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 470/936] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:37:33 2022] GET /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9 => generated 1277 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:37:34.803291 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-52fa77c6-54d5-481c-b094-65d467c5ec7d req-637b0a6c-1ab7-4abb-acfe-6af2372443f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "691b5aff-f98b-4d30-86b9-70c933c401b9", "tag": "1389ef99-7202-48fb-bea3-9376dc260d9c"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:37:34.813848 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-52fa77c6-54d5-481c-b094-65d467c5ec7d req-637b0a6c-1ab7-4abb-acfe-6af2372443f4 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:34.814330 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-52fa77c6-54d5-481c-b094-65d467c5ec7d req-637b0a6c-1ab7-4abb-acfe-6af2372443f4 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:34.814756 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-52fa77c6-54d5-481c-b094-65d467c5ec7d req-637b0a6c-1ab7-4abb-acfe-6af2372443f4 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:34.826377 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-52fa77c6-54d5-481c-b094-65d467c5ec7d req-637b0a6c-1ab7-4abb-acfe-6af2372443f4 service nova] Creating event network-changed:1389ef99-7202-48fb-bea3-9376dc260d9c for instance 691b5aff-f98b-4d30-86b9-70c933c401b9 on hv-cinder-78481 Aug 12 01:37:34.831641 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-52fa77c6-54d5-481c-b094-65d467c5ec7d req-637b0a6c-1ab7-4abb-acfe-6af2372443f4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032346 Aug 12 01:37:34.832250 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 467/937] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:37:35.030515 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-bcc0212b-1cd3-49b2-9adb-3b1e0c1af93f tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:35.031354 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-bcc0212b-1cd3-49b2-9adb-3b1e0c1af93f tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] [instance: 91cd8600-9e0f-4e1b-946c-fca3bd75ff1e] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:35.038245 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-bcc0212b-1cd3-49b2-9adb-3b1e0c1af93f tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:35.038764 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-bcc0212b-1cd3-49b2-9adb-3b1e0c1af93f tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:35.039170 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-bcc0212b-1cd3-49b2-9adb-3b1e0c1af93f tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:35.039900 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-bcc0212b-1cd3-49b2-9adb-3b1e0c1af93f tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:35.040704 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-bcc0212b-1cd3-49b2-9adb-3b1e0c1af93f tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:35.040913 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-bcc0212b-1cd3-49b2-9adb-3b1e0c1af93f tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:35.060557 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-245c4d45-ef37-41cc-9267-3af5cbfb823d tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:35.061427 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-245c4d45-ef37-41cc-9267-3af5cbfb823d tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: 691b5aff-f98b-4d30-86b9-70c933c401b9] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:35.068204 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-245c4d45-ef37-41cc-9267-3af5cbfb823d tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:35.068612 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-245c4d45-ef37-41cc-9267-3af5cbfb823d tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:35.069048 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-245c4d45-ef37-41cc-9267-3af5cbfb823d tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:35.069738 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-245c4d45-ef37-41cc-9267-3af5cbfb823d tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:35.070181 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-245c4d45-ef37-41cc-9267-3af5cbfb823d tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:35.070593 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-245c4d45-ef37-41cc-9267-3af5cbfb823d tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:35.121146 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-bcc0212b-1cd3-49b2-9adb-3b1e0c1af93f tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1704db27ab4c879a926cdf0bf66457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fab5e5f4de84221a00719892a04e7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:37:35.128889 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-bcc0212b-1cd3-49b2-9adb-3b1e0c1af93f tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] 10.222.0.20 "GET /compute/v2.1/servers/91cd8600-9e0f-4e1b-946c-fca3bd75ff1e" status: 200 len: 1273 microversion: 2.1 time: 0.102741 Aug 12 01:37:35.129466 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 471/938] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:37:35 2022] GET /compute/v2.1/servers/91cd8600-9e0f-4e1b-946c-fca3bd75ff1e => generated 1273 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:37:35.218781 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-245c4d45-ef37-41cc-9267-3af5cbfb823d tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d94989669a458db647bd8344087efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c325ffbf006f4c8fa8ce5f370a157c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:37:35.226760 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-245c4d45-ef37-41cc-9267-3af5cbfb823d tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] 10.222.0.20 "GET /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9" status: 200 len: 1319 microversion: 2.1 time: 0.174754 Aug 12 01:37:35.227409 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 468/939] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:37:35 2022] GET /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:37:36.151400 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-51f759f4-ffbf-4d87-9d45-39337adbe724 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:36.152022 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-51f759f4-ffbf-4d87-9d45-39337adbe724 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] [instance: 91cd8600-9e0f-4e1b-946c-fca3bd75ff1e] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:36.158666 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-51f759f4-ffbf-4d87-9d45-39337adbe724 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:36.159237 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-51f759f4-ffbf-4d87-9d45-39337adbe724 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:36.159787 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-51f759f4-ffbf-4d87-9d45-39337adbe724 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:36.160640 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-51f759f4-ffbf-4d87-9d45-39337adbe724 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:36.161177 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-51f759f4-ffbf-4d87-9d45-39337adbe724 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:36.161661 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-51f759f4-ffbf-4d87-9d45-39337adbe724 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:36.250063 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-9e6d0180-a554-4a27-a77f-879c8d34af6c tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:36.250686 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-9e6d0180-a554-4a27-a77f-879c8d34af6c tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: 691b5aff-f98b-4d30-86b9-70c933c401b9] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:36.258132 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9e6d0180-a554-4a27-a77f-879c8d34af6c tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:36.258707 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9e6d0180-a554-4a27-a77f-879c8d34af6c tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:36.259400 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9e6d0180-a554-4a27-a77f-879c8d34af6c tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:36.260863 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9e6d0180-a554-4a27-a77f-879c8d34af6c tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:36.261324 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9e6d0180-a554-4a27-a77f-879c8d34af6c tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:36.261744 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9e6d0180-a554-4a27-a77f-879c8d34af6c tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:36.320317 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-51f759f4-ffbf-4d87-9d45-39337adbe724 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1704db27ab4c879a926cdf0bf66457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fab5e5f4de84221a00719892a04e7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:37:36.331207 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-51f759f4-ffbf-4d87-9d45-39337adbe724 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] 10.222.0.20 "GET /compute/v2.1/servers/91cd8600-9e0f-4e1b-946c-fca3bd75ff1e" status: 200 len: 1315 microversion: 2.1 time: 0.185342 Aug 12 01:37:36.344301 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 472/940] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:37:36 2022] GET /compute/v2.1/servers/91cd8600-9e0f-4e1b-946c-fca3bd75ff1e => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:37:36.411943 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-9e6d0180-a554-4a27-a77f-879c8d34af6c tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d94989669a458db647bd8344087efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c325ffbf006f4c8fa8ce5f370a157c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:37:36.419491 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-9e6d0180-a554-4a27-a77f-879c8d34af6c tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] 10.222.0.20 "GET /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9" status: 200 len: 1319 microversion: 2.1 time: 0.176345 Aug 12 01:37:36.420078 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 469/941] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:37:36 2022] GET /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:37:37.353314 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-2c1febe1-0a06-49a9-9cfa-42ce584a4a08 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:37.354382 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-2c1febe1-0a06-49a9-9cfa-42ce584a4a08 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] [instance: 91cd8600-9e0f-4e1b-946c-fca3bd75ff1e] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:37.361270 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2c1febe1-0a06-49a9-9cfa-42ce584a4a08 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:37.361742 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2c1febe1-0a06-49a9-9cfa-42ce584a4a08 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:37.362397 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2c1febe1-0a06-49a9-9cfa-42ce584a4a08 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:37.363101 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2c1febe1-0a06-49a9-9cfa-42ce584a4a08 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:37.363552 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2c1febe1-0a06-49a9-9cfa-42ce584a4a08 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:37.363960 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-2c1febe1-0a06-49a9-9cfa-42ce584a4a08 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:37.442257 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-9280ae39-ea38-4d24-bfa8-d351eaecdea2 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:37.443180 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-9280ae39-ea38-4d24-bfa8-d351eaecdea2 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: 691b5aff-f98b-4d30-86b9-70c933c401b9] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:37.450838 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9280ae39-ea38-4d24-bfa8-d351eaecdea2 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:37.451384 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9280ae39-ea38-4d24-bfa8-d351eaecdea2 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:37.452070 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9280ae39-ea38-4d24-bfa8-d351eaecdea2 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:37.453048 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9280ae39-ea38-4d24-bfa8-d351eaecdea2 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:37.453700 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9280ae39-ea38-4d24-bfa8-d351eaecdea2 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:37.454337 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9280ae39-ea38-4d24-bfa8-d351eaecdea2 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:37.536812 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-2c1febe1-0a06-49a9-9cfa-42ce584a4a08 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1704db27ab4c879a926cdf0bf66457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fab5e5f4de84221a00719892a04e7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:37:37.544743 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-2c1febe1-0a06-49a9-9cfa-42ce584a4a08 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] 10.222.0.20 "GET /compute/v2.1/servers/91cd8600-9e0f-4e1b-946c-fca3bd75ff1e" status: 200 len: 1315 microversion: 2.1 time: 0.196041 Aug 12 01:37:37.545436 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 473/942] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:37:37 2022] GET /compute/v2.1/servers/91cd8600-9e0f-4e1b-946c-fca3bd75ff1e => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:37:37.563854 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-9b4b0c98-0f26-4b99-beb6-15680dbd8a0b req-4c51be09-d896-4df6-8152-243eec4f0867 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91cd8600-9e0f-4e1b-946c-fca3bd75ff1e", "tag": "f2b0629a-9a02-4349-9105-00c9206a7216"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:37:37.574515 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-9b4b0c98-0f26-4b99-beb6-15680dbd8a0b req-4c51be09-d896-4df6-8152-243eec4f0867 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:37.574987 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-9b4b0c98-0f26-4b99-beb6-15680dbd8a0b req-4c51be09-d896-4df6-8152-243eec4f0867 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:37.575408 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-9b4b0c98-0f26-4b99-beb6-15680dbd8a0b req-4c51be09-d896-4df6-8152-243eec4f0867 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:37.587246 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-9b4b0c98-0f26-4b99-beb6-15680dbd8a0b req-4c51be09-d896-4df6-8152-243eec4f0867 service nova] Creating event network-changed:f2b0629a-9a02-4349-9105-00c9206a7216 for instance 91cd8600-9e0f-4e1b-946c-fca3bd75ff1e on hv-cinder-78481 Aug 12 01:37:37.592216 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-9b4b0c98-0f26-4b99-beb6-15680dbd8a0b req-4c51be09-d896-4df6-8152-243eec4f0867 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032033 Aug 12 01:37:37.592804 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 474/943] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:37:37.606531 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-9280ae39-ea38-4d24-bfa8-d351eaecdea2 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d94989669a458db647bd8344087efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c325ffbf006f4c8fa8ce5f370a157c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:37:37.614183 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-9280ae39-ea38-4d24-bfa8-d351eaecdea2 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] 10.222.0.20 "GET /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9" status: 200 len: 1319 microversion: 2.1 time: 0.176474 Aug 12 01:37:37.614861 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 470/944] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:37:37 2022] GET /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:37:38.569508 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-3fc4a678-cd02-42ab-b380-55cab7d0a29f tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:38.570164 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-3fc4a678-cd02-42ab-b380-55cab7d0a29f tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] [instance: 91cd8600-9e0f-4e1b-946c-fca3bd75ff1e] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:38.577046 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3fc4a678-cd02-42ab-b380-55cab7d0a29f tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:38.577533 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3fc4a678-cd02-42ab-b380-55cab7d0a29f tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:38.577952 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3fc4a678-cd02-42ab-b380-55cab7d0a29f tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:38.578645 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3fc4a678-cd02-42ab-b380-55cab7d0a29f tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:38.579085 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3fc4a678-cd02-42ab-b380-55cab7d0a29f tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:38.579502 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3fc4a678-cd02-42ab-b380-55cab7d0a29f tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:38.635087 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-ea0834d0-9eba-4a12-9714-3e7214a1bae7 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:38.635757 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-ea0834d0-9eba-4a12-9714-3e7214a1bae7 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: 691b5aff-f98b-4d30-86b9-70c933c401b9] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:38.642536 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ea0834d0-9eba-4a12-9714-3e7214a1bae7 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:38.643004 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ea0834d0-9eba-4a12-9714-3e7214a1bae7 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:38.643454 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ea0834d0-9eba-4a12-9714-3e7214a1bae7 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:38.644185 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ea0834d0-9eba-4a12-9714-3e7214a1bae7 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:38.644643 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ea0834d0-9eba-4a12-9714-3e7214a1bae7 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:38.645424 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ea0834d0-9eba-4a12-9714-3e7214a1bae7 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:38.762636 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-3fc4a678-cd02-42ab-b380-55cab7d0a29f tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1704db27ab4c879a926cdf0bf66457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fab5e5f4de84221a00719892a04e7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:37:38.770848 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-3fc4a678-cd02-42ab-b380-55cab7d0a29f tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] 10.222.0.20 "GET /compute/v2.1/servers/91cd8600-9e0f-4e1b-946c-fca3bd75ff1e" status: 200 len: 1315 microversion: 2.1 time: 0.206065 Aug 12 01:37:38.784021 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 475/945] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:37:38 2022] GET /compute/v2.1/servers/91cd8600-9e0f-4e1b-946c-fca3bd75ff1e => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:37:38.810824 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-ea0834d0-9eba-4a12-9714-3e7214a1bae7 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d94989669a458db647bd8344087efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c325ffbf006f4c8fa8ce5f370a157c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:37:38.818748 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-ea0834d0-9eba-4a12-9714-3e7214a1bae7 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] 10.222.0.20 "GET /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9" status: 200 len: 1319 microversion: 2.1 time: 0.187836 Aug 12 01:37:38.819317 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 471/946] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:37:38 2022] GET /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9 => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:37:39.796893 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-b9e2ca76-0575-4750-822b-28f8d9236347 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:39.797807 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-b9e2ca76-0575-4750-822b-28f8d9236347 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] [instance: 91cd8600-9e0f-4e1b-946c-fca3bd75ff1e] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:39.808355 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b9e2ca76-0575-4750-822b-28f8d9236347 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:39.808828 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b9e2ca76-0575-4750-822b-28f8d9236347 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:39.809255 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b9e2ca76-0575-4750-822b-28f8d9236347 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:39.809934 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b9e2ca76-0575-4750-822b-28f8d9236347 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:39.810378 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b9e2ca76-0575-4750-822b-28f8d9236347 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:39.810796 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b9e2ca76-0575-4750-822b-28f8d9236347 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:39.839974 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-9f7e1b50-9e99-4cb3-a815-fe4eaab0007e tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:39.840612 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-9f7e1b50-9e99-4cb3-a815-fe4eaab0007e tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: 691b5aff-f98b-4d30-86b9-70c933c401b9] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:39.847326 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9f7e1b50-9e99-4cb3-a815-fe4eaab0007e tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:39.847833 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9f7e1b50-9e99-4cb3-a815-fe4eaab0007e tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:39.848260 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9f7e1b50-9e99-4cb3-a815-fe4eaab0007e tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:39.848965 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9f7e1b50-9e99-4cb3-a815-fe4eaab0007e tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:39.849405 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9f7e1b50-9e99-4cb3-a815-fe4eaab0007e tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:39.849815 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9f7e1b50-9e99-4cb3-a815-fe4eaab0007e tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:39.999956 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-b9e2ca76-0575-4750-822b-28f8d9236347 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1704db27ab4c879a926cdf0bf66457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fab5e5f4de84221a00719892a04e7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:37:40.008053 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-b9e2ca76-0575-4750-822b-28f8d9236347 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] 10.222.0.20 "GET /compute/v2.1/servers/91cd8600-9e0f-4e1b-946c-fca3bd75ff1e" status: 200 len: 1315 microversion: 2.1 time: 0.217584 Aug 12 01:37:40.019313 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 476/947] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:37:39 2022] GET /compute/v2.1/servers/91cd8600-9e0f-4e1b-946c-fca3bd75ff1e => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:37:40.027628 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-9f7e1b50-9e99-4cb3-a815-fe4eaab0007e tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d94989669a458db647bd8344087efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c325ffbf006f4c8fa8ce5f370a157c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:37:40.036279 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-9f7e1b50-9e99-4cb3-a815-fe4eaab0007e tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] 10.222.0.20 "GET /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9" status: 200 len: 1319 microversion: 2.1 time: 0.200396 Aug 12 01:37:40.036966 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 472/948] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:37:39 2022] GET /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:37:40.264722 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-4947f037-c656-4113-ac01-03931d8f388a req-52d6d608-1a80-4607-8df0-01c7e5673e41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "691b5aff-f98b-4d30-86b9-70c933c401b9", "name": "network-vif-plugged", "status": "completed", "tag": "1389ef99-7202-48fb-bea3-9376dc260d9c"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:37:40.274220 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-4947f037-c656-4113-ac01-03931d8f388a req-52d6d608-1a80-4607-8df0-01c7e5673e41 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:40.274693 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-4947f037-c656-4113-ac01-03931d8f388a req-52d6d608-1a80-4607-8df0-01c7e5673e41 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:40.275119 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-4947f037-c656-4113-ac01-03931d8f388a req-52d6d608-1a80-4607-8df0-01c7e5673e41 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:40.286904 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-4947f037-c656-4113-ac01-03931d8f388a req-52d6d608-1a80-4607-8df0-01c7e5673e41 service nova] Creating event network-vif-plugged:1389ef99-7202-48fb-bea3-9376dc260d9c for instance 691b5aff-f98b-4d30-86b9-70c933c401b9 on hv-cinder-78481 Aug 12 01:37:40.292291 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-4947f037-c656-4113-ac01-03931d8f388a req-52d6d608-1a80-4607-8df0-01c7e5673e41 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031618 Aug 12 01:37:40.292907 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 477/949] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:37:41.031896 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-4e4d3526-cd52-42db-a06e-77e7720e5f14 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:41.032893 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-4e4d3526-cd52-42db-a06e-77e7720e5f14 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] [instance: 91cd8600-9e0f-4e1b-946c-fca3bd75ff1e] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:41.042841 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4e4d3526-cd52-42db-a06e-77e7720e5f14 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:41.043302 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4e4d3526-cd52-42db-a06e-77e7720e5f14 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:41.043829 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4e4d3526-cd52-42db-a06e-77e7720e5f14 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:41.044491 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4e4d3526-cd52-42db-a06e-77e7720e5f14 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:41.044919 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4e4d3526-cd52-42db-a06e-77e7720e5f14 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:41.045325 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4e4d3526-cd52-42db-a06e-77e7720e5f14 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:41.058946 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-ef0f0daf-3dcd-4856-a892-efc4f300c286 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:41.059763 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-ef0f0daf-3dcd-4856-a892-efc4f300c286 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: 691b5aff-f98b-4d30-86b9-70c933c401b9] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:41.066445 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ef0f0daf-3dcd-4856-a892-efc4f300c286 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:41.066955 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ef0f0daf-3dcd-4856-a892-efc4f300c286 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:41.067384 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ef0f0daf-3dcd-4856-a892-efc4f300c286 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:41.068109 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ef0f0daf-3dcd-4856-a892-efc4f300c286 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:41.068561 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ef0f0daf-3dcd-4856-a892-efc4f300c286 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:41.068971 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-ef0f0daf-3dcd-4856-a892-efc4f300c286 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:41.240760 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-4e4d3526-cd52-42db-a06e-77e7720e5f14 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1704db27ab4c879a926cdf0bf66457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fab5e5f4de84221a00719892a04e7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:37:41.243672 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-ef0f0daf-3dcd-4856-a892-efc4f300c286 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d94989669a458db647bd8344087efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c325ffbf006f4c8fa8ce5f370a157c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:37:41.248488 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-4e4d3526-cd52-42db-a06e-77e7720e5f14 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] 10.222.0.20 "GET /compute/v2.1/servers/91cd8600-9e0f-4e1b-946c-fca3bd75ff1e" status: 200 len: 1315 microversion: 2.1 time: 0.223112 Aug 12 01:37:41.249059 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 473/950] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:37:41 2022] GET /compute/v2.1/servers/91cd8600-9e0f-4e1b-946c-fca3bd75ff1e => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:37:41.251235 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-ef0f0daf-3dcd-4856-a892-efc4f300c286 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] 10.222.0.20 "GET /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9" status: 200 len: 1319 microversion: 2.1 time: 0.197532 Aug 12 01:37:41.251860 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 478/951] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:37:41 2022] GET /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9 => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:37:42.273354 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-d1b72641-2227-4e10-9455-90558fd3d7eb tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:42.274154 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-870d9648-6965-4f94-bd47-539f1a16fa95 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:42.274679 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-d1b72641-2227-4e10-9455-90558fd3d7eb tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] [instance: 91cd8600-9e0f-4e1b-946c-fca3bd75ff1e] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:42.274852 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-870d9648-6965-4f94-bd47-539f1a16fa95 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: 691b5aff-f98b-4d30-86b9-70c933c401b9] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:42.283343 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-870d9648-6965-4f94-bd47-539f1a16fa95 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:42.283743 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d1b72641-2227-4e10-9455-90558fd3d7eb tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:42.284038 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d1b72641-2227-4e10-9455-90558fd3d7eb tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:42.284268 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-870d9648-6965-4f94-bd47-539f1a16fa95 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:42.284504 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d1b72641-2227-4e10-9455-90558fd3d7eb tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:42.284737 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-870d9648-6965-4f94-bd47-539f1a16fa95 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:42.285483 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d1b72641-2227-4e10-9455-90558fd3d7eb tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:42.285665 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-870d9648-6965-4f94-bd47-539f1a16fa95 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:42.285984 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d1b72641-2227-4e10-9455-90558fd3d7eb tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:42.286200 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-870d9648-6965-4f94-bd47-539f1a16fa95 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:42.286544 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-d1b72641-2227-4e10-9455-90558fd3d7eb tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:42.286755 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-870d9648-6965-4f94-bd47-539f1a16fa95 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:42.482128 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-870d9648-6965-4f94-bd47-539f1a16fa95 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d94989669a458db647bd8344087efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c325ffbf006f4c8fa8ce5f370a157c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:37:42.485120 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-d1b72641-2227-4e10-9455-90558fd3d7eb tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1704db27ab4c879a926cdf0bf66457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fab5e5f4de84221a00719892a04e7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:37:42.490376 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-870d9648-6965-4f94-bd47-539f1a16fa95 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] 10.222.0.20 "GET /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9" status: 200 len: 1509 microversion: 2.1 time: 0.221781 Aug 12 01:37:42.490945 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 479/952] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:37:42 2022] GET /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9 => generated 1509 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:37:42.492576 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-d1b72641-2227-4e10-9455-90558fd3d7eb tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] 10.222.0.20 "GET /compute/v2.1/servers/91cd8600-9e0f-4e1b-946c-fca3bd75ff1e" status: 200 len: 1315 microversion: 2.1 time: 0.224783 Aug 12 01:37:42.493254 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 474/953] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:37:42 2022] GET /compute/v2.1/servers/91cd8600-9e0f-4e1b-946c-fca3bd75ff1e => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:37:42.495447 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-ebad843d-446c-4f0a-b400-36aa865eaed9 req-0ef7a526-329b-4a3b-9eec-f59382cb2500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91cd8600-9e0f-4e1b-946c-fca3bd75ff1e", "name": "network-vif-plugged", "status": "completed", "tag": "f2b0629a-9a02-4349-9105-00c9206a7216"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:37:42.504957 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-ebad843d-446c-4f0a-b400-36aa865eaed9 req-0ef7a526-329b-4a3b-9eec-f59382cb2500 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:42.505650 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-ebad843d-446c-4f0a-b400-36aa865eaed9 req-0ef7a526-329b-4a3b-9eec-f59382cb2500 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:42.506068 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-ebad843d-446c-4f0a-b400-36aa865eaed9 req-0ef7a526-329b-4a3b-9eec-f59382cb2500 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:42.511919 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-df1e8432-30d3-4d5d-9126-6e4fd23a63b8 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b20fad31-dbc1-4de1-8dab-75cfb7c3b793", "device": "/dev/sdb"}} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:37:42.514788 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-df1e8432-30d3-4d5d-9126-6e4fd23a63b8 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: 691b5aff-f98b-4d30-86b9-70c933c401b9] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:42.517542 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-ebad843d-446c-4f0a-b400-36aa865eaed9 req-0ef7a526-329b-4a3b-9eec-f59382cb2500 service nova] Creating event network-vif-plugged:f2b0629a-9a02-4349-9105-00c9206a7216 for instance 91cd8600-9e0f-4e1b-946c-fca3bd75ff1e on hv-cinder-78481 Aug 12 01:37:42.520866 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-df1e8432-30d3-4d5d-9126-6e4fd23a63b8 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:42.521409 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-df1e8432-30d3-4d5d-9126-6e4fd23a63b8 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:42.521902 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-df1e8432-30d3-4d5d-9126-6e4fd23a63b8 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:42.522352 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-ebad843d-446c-4f0a-b400-36aa865eaed9 req-0ef7a526-329b-4a3b-9eec-f59382cb2500 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030334 Aug 12 01:37:42.522585 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-df1e8432-30d3-4d5d-9126-6e4fd23a63b8 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:42.522974 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 480/954] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:37:42.523134 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-df1e8432-30d3-4d5d-9126-6e4fd23a63b8 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:42.523478 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-df1e8432-30d3-4d5d-9126-6e4fd23a63b8 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:42.777579 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-df1e8432-30d3-4d5d-9126-6e4fd23a63b8 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] 10.222.0.20 "POST /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269627 Aug 12 01:37:42.778146 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 475/955] 10.222.0.20 () {60 vars in 1323 bytes} [Fri Aug 12 01:37:42 2022] POST /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:37:43.519160 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-8ca69387-d187-4f46-8e88-b43502477c40 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:43.520323 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-8ca69387-d187-4f46-8e88-b43502477c40 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] [instance: 91cd8600-9e0f-4e1b-946c-fca3bd75ff1e] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:43.528914 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8ca69387-d187-4f46-8e88-b43502477c40 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:43.529415 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8ca69387-d187-4f46-8e88-b43502477c40 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:43.529872 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8ca69387-d187-4f46-8e88-b43502477c40 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:43.530583 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8ca69387-d187-4f46-8e88-b43502477c40 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:43.531028 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8ca69387-d187-4f46-8e88-b43502477c40 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:43.531445 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-8ca69387-d187-4f46-8e88-b43502477c40 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:43.671503 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-8ca69387-d187-4f46-8e88-b43502477c40 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1704db27ab4c879a926cdf0bf66457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fab5e5f4de84221a00719892a04e7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:37:43.679462 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-8ca69387-d187-4f46-8e88-b43502477c40 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] 10.222.0.20 "GET /compute/v2.1/servers/91cd8600-9e0f-4e1b-946c-fca3bd75ff1e" status: 200 len: 1315 microversion: 2.1 time: 0.168079 Aug 12 01:37:43.680077 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 481/956] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:37:43 2022] GET /compute/v2.1/servers/91cd8600-9e0f-4e1b-946c-fca3bd75ff1e => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:37:44.700445 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell0:SELECT=6 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:37:44.707267 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-da4c5108-650f-4131-82b7-5cfc4d9af882 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:44.708337 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-da4c5108-650f-4131-82b7-5cfc4d9af882 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] [instance: 91cd8600-9e0f-4e1b-946c-fca3bd75ff1e] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:44.719089 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-da4c5108-650f-4131-82b7-5cfc4d9af882 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:44.719923 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-da4c5108-650f-4131-82b7-5cfc4d9af882 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:44.720621 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-da4c5108-650f-4131-82b7-5cfc4d9af882 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:44.721741 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-da4c5108-650f-4131-82b7-5cfc4d9af882 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:44.722547 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-da4c5108-650f-4131-82b7-5cfc4d9af882 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:44.723203 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-da4c5108-650f-4131-82b7-5cfc4d9af882 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:44.858984 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-da4c5108-650f-4131-82b7-5cfc4d9af882 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1704db27ab4c879a926cdf0bf66457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fab5e5f4de84221a00719892a04e7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:37:44.870785 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-da4c5108-650f-4131-82b7-5cfc4d9af882 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] 10.222.0.20 "GET /compute/v2.1/servers/91cd8600-9e0f-4e1b-946c-fca3bd75ff1e" status: 200 len: 1465 microversion: 2.1 time: 0.172601 Aug 12 01:37:44.871565 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 476/957] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:37:44 2022] GET /compute/v2.1/servers/91cd8600-9e0f-4e1b-946c-fca3bd75ff1e => generated 1465 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:37:44.923011 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-5e501661-bacc-466e-a36e-365d8c958c4c tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:44.923490 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-5e501661-bacc-466e-a36e-365d8c958c4c tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] [instance: 91cd8600-9e0f-4e1b-946c-fca3bd75ff1e] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:44.925747 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell0:SELECT=4 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:37:44.926400 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell0:SELECT=16 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:37:44.932594 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5e501661-bacc-466e-a36e-365d8c958c4c tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:44.933066 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5e501661-bacc-466e-a36e-365d8c958c4c tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:44.933487 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5e501661-bacc-466e-a36e-365d8c958c4c tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:44.934160 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5e501661-bacc-466e-a36e-365d8c958c4c tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:44.934614 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5e501661-bacc-466e-a36e-365d8c958c4c tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:44.935029 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5e501661-bacc-466e-a36e-365d8c958c4c tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:44.962837 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-5e501661-bacc-466e-a36e-365d8c958c4c tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] [instance: 91cd8600-9e0f-4e1b-946c-fca3bd75ff1e] Going to try to terminate instance {{(pid=120786) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 01:37:45.037761 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-5e501661-bacc-466e-a36e-365d8c958c4c tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] 10.222.0.20 "DELETE /compute/v2.1/servers/91cd8600-9e0f-4e1b-946c-fca3bd75ff1e" status: 204 len: 0 microversion: 2.1 time: 0.118220 Aug 12 01:37:45.038762 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 482/958] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 01:37:44 2022] DELETE /compute/v2.1/servers/91cd8600-9e0f-4e1b-946c-fca3bd75ff1e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 01:37:45.047141 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-9b23ef7f-81d2-4878-972b-b24218d14f31 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:45.047779 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-9b23ef7f-81d2-4878-972b-b24218d14f31 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] [instance: 91cd8600-9e0f-4e1b-946c-fca3bd75ff1e] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:45.054281 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9b23ef7f-81d2-4878-972b-b24218d14f31 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:45.054762 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9b23ef7f-81d2-4878-972b-b24218d14f31 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:45.055192 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9b23ef7f-81d2-4878-972b-b24218d14f31 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:45.055908 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9b23ef7f-81d2-4878-972b-b24218d14f31 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:45.056356 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9b23ef7f-81d2-4878-972b-b24218d14f31 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:45.056814 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9b23ef7f-81d2-4878-972b-b24218d14f31 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:45.193519 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-9b23ef7f-81d2-4878-972b-b24218d14f31 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1704db27ab4c879a926cdf0bf66457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fab5e5f4de84221a00719892a04e7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:37:45.201071 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-9b23ef7f-81d2-4878-972b-b24218d14f31 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] 10.222.0.20 "GET /compute/v2.1/servers/91cd8600-9e0f-4e1b-946c-fca3bd75ff1e" status: 200 len: 1471 microversion: 2.1 time: 0.158067 Aug 12 01:37:45.201634 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 477/959] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:37:45 2022] GET /compute/v2.1/servers/91cd8600-9e0f-4e1b-946c-fca3bd75ff1e => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:37:46.227129 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-3fcec178-a116-4f4c-84fc-849a04954d58 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:46.228170 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-3fcec178-a116-4f4c-84fc-849a04954d58 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] [instance: 91cd8600-9e0f-4e1b-946c-fca3bd75ff1e] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:46.235500 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3fcec178-a116-4f4c-84fc-849a04954d58 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:46.236015 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3fcec178-a116-4f4c-84fc-849a04954d58 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:46.236442 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3fcec178-a116-4f4c-84fc-849a04954d58 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:46.237130 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3fcec178-a116-4f4c-84fc-849a04954d58 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:46.237577 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3fcec178-a116-4f4c-84fc-849a04954d58 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:46.237995 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-3fcec178-a116-4f4c-84fc-849a04954d58 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:46.376479 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-3fcec178-a116-4f4c-84fc-849a04954d58 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1704db27ab4c879a926cdf0bf66457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fab5e5f4de84221a00719892a04e7f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:37:46.384257 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-3fcec178-a116-4f4c-84fc-849a04954d58 tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] 10.222.0.20 "GET /compute/v2.1/servers/91cd8600-9e0f-4e1b-946c-fca3bd75ff1e" status: 200 len: 1471 microversion: 2.1 time: 0.164490 Aug 12 01:37:46.384873 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 483/960] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:37:46 2022] GET /compute/v2.1/servers/91cd8600-9e0f-4e1b-946c-fca3bd75ff1e => generated 1471 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:37:46.784896 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-1586c93d-f2f5-43b8-bf1b-c44ec69b3967 req-490fa4ed-f0cb-4522-acb0-f74ad8abe226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91cd8600-9e0f-4e1b-946c-fca3bd75ff1e", "name": "network-vif-deleted", "tag": "f2b0629a-9a02-4349-9105-00c9206a7216"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:37:46.795191 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-1586c93d-f2f5-43b8-bf1b-c44ec69b3967 req-490fa4ed-f0cb-4522-acb0-f74ad8abe226 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:46.795772 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-1586c93d-f2f5-43b8-bf1b-c44ec69b3967 req-490fa4ed-f0cb-4522-acb0-f74ad8abe226 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:46.796205 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-1586c93d-f2f5-43b8-bf1b-c44ec69b3967 req-490fa4ed-f0cb-4522-acb0-f74ad8abe226 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:46.808525 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-1586c93d-f2f5-43b8-bf1b-c44ec69b3967 req-490fa4ed-f0cb-4522-acb0-f74ad8abe226 service nova] Creating event network-vif-deleted:f2b0629a-9a02-4349-9105-00c9206a7216 for instance 91cd8600-9e0f-4e1b-946c-fca3bd75ff1e on hv-cinder-78481 Aug 12 01:37:46.813554 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-1586c93d-f2f5-43b8-bf1b-c44ec69b3967 req-490fa4ed-f0cb-4522-acb0-f74ad8abe226 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032219 Aug 12 01:37:46.814224 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 478/961] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:37:47.405517 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-4942b823-5871-4ae5-b553-8bbf36388ced tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:47.406156 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-4942b823-5871-4ae5-b553-8bbf36388ced tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] [instance: 91cd8600-9e0f-4e1b-946c-fca3bd75ff1e] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:47.412608 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4942b823-5871-4ae5-b553-8bbf36388ced tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:47.413087 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4942b823-5871-4ae5-b553-8bbf36388ced tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:47.413514 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4942b823-5871-4ae5-b553-8bbf36388ced tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:47.414199 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4942b823-5871-4ae5-b553-8bbf36388ced tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:47.414648 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4942b823-5871-4ae5-b553-8bbf36388ced tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:47.415071 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4942b823-5871-4ae5-b553-8bbf36388ced tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:47.429377 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.wsgi [None req-4942b823-5871-4ae5-b553-8bbf36388ced tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] HTTP exception thrown: Instance 91cd8600-9e0f-4e1b-946c-fca3bd75ff1e could not be found. Aug 12 01:37:47.431034 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-4942b823-5871-4ae5-b553-8bbf36388ced tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Request method failure captured: Aug 12 01:37:47.431034 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: request: GET /compute/v2.1/servers/91cd8600-9e0f-4e1b-946c-fca3bd75ff1e HTTP/1.1 Aug 12 01:37:47.431034 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept: application/json Aug 12 01:37:47.431034 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept-Encoding: identity Aug 12 01:37:47.431034 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Connection: close Aug 12 01:37:47.431034 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Length: 0 Aug 12 01:37:47.431034 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Type: application/json Aug 12 01:37:47.431034 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Host: 10.222.0.20 Aug 12 01:37:47.431034 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Openstack-System-Scope: None Aug 12 01:37:47.431034 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: User-Agent: python-urllib3/1.26.11 Aug 12 01:37:47.431034 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Auth-Token: gAAAAABi9a7bTCaw4ujLe1ioHIEXMMdqJTJceV0_xFGP5HlBRXEGINRWj12vbKPglsGIt5WrnFR6aKNb6K0yCvuf8jgl7cyUca9wiJTaq2NqX0W8-La9_xBoA2qa2qKJtip-OUWghV2g6ja5dely2Jjl8ANLvSTtBSqB2drsBOgMd6SyIoLZO_0 Aug 12 01:37:47.431034 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Id: None Aug 12 01:37:47.431034 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Name: None Aug 12 01:37:47.431034 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Identity-Status: Confirmed Aug 12 01:37:47.431034 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Is-Admin-Project: True Aug 12 01:37:47.431034 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Id: default Aug 12 01:37:47.431034 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Name: Default Aug 12 01:37:47.431034 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Id: 5fab5e5f4de84221a00719892a04e7f8 Aug 12 01:37:47.431034 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Name: tempest-VolumesNegativeTest-479118036 Aug 12 01:37:47.431034 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Role: member,reader Aug 12 01:37:47.431034 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Roles: member,reader Aug 12 01:37:47.432937 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5fab5e5f4de84221a00719892a04e7f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5fab5e5f4de84221a00719892a04e7f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5fab5e5f4de84221a00719892a04e7f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5fab5e5f4de84221a00719892a04e7f8"}]}] Aug 12 01:37:47.432937 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant: tempest-VolumesNegativeTest-479118036 Aug 12 01:37:47.432937 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Id: 5fab5e5f4de84221a00719892a04e7f8 Aug 12 01:37:47.432937 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Name: tempest-VolumesNegativeTest-479118036 Aug 12 01:37:47.432937 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User: tempest-VolumesNegativeTest-479118036-project Aug 12 01:37:47.432937 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Id: default Aug 12 01:37:47.432937 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Name: Default Aug 12 01:37:47.432937 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Id: 8d1704db27ab4c879a926cdf0bf66457 Aug 12 01:37:47.432937 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Name: tempest-VolumesNegativeTest-479118036-project Aug 12 01:37:47.432937 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: method: > Aug 12 01:37:47.432937 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: exception: Instance 91cd8600-9e0f-4e1b-946c-fca3bd75ff1e could not be found. Aug 12 01:37:47.432937 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: action_args: {'id': '91cd8600-9e0f-4e1b-946c-fca3bd75ff1e'} Aug 12 01:37:47.433952 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:37:47.433952 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:37:47.433952 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:37:47.433952 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:37:47.433952 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:37:47.433952 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:37:47.433952 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:37:47.433952 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:37:47.433952 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:37:47.433952 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:37:47.433952 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91cd8600-9e0f-4e1b-946c-fca3bd75ff1e could not be found. Aug 12 01:37:47.433952 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:37:47.433952 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:37:47.433952 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:37:47.433952 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:37:47.433952 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:37:47.433952 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:37:47.433952 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:37:47.433952 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:37:47.433952 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:37:47.435299 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:37:47.435299 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 01:37:47.435299 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 01:37:47.435299 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:37:47.435299 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:37:47.435299 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:37:47.435299 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:37:47.435299 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91cd8600-9e0f-4e1b-946c-fca3bd75ff1e could not be found. Aug 12 01:37:47.435299 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:37:47.435299 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:37:47.435299 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:37:47.435299 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:37:47.435299 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:37:47.435299 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:37:47.435299 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:37:47.435299 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:37:47.435299 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91cd8600-9e0f-4e1b-946c-fca3bd75ff1e could not be found. Aug 12 01:37:47.435299 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:37:47.436536 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-4942b823-5871-4ae5-b553-8bbf36388ced tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] Returning 404 to user: Instance 91cd8600-9e0f-4e1b-946c-fca3bd75ff1e could not be found. {{(pid=120786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:37:47.436536 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-4942b823-5871-4ae5-b553-8bbf36388ced tempest-VolumesNegativeTest-479118036 tempest-VolumesNegativeTest-479118036-project] 10.222.0.20 "GET /compute/v2.1/servers/91cd8600-9e0f-4e1b-946c-fca3bd75ff1e" status: 404 len: 111 microversion: 2.1 time: 0.030967 Aug 12 01:37:47.436536 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 484/962] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:37:47 2022] GET /compute/v2.1/servers/91cd8600-9e0f-4e1b-946c-fca3bd75ff1e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:37:48.191709 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-dea74825-62a6-4243-8380-1d89f4ecefb9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:48.192370 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-dea74825-62a6-4243-8380-1d89f4ecefb9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: 8c36d121-4610-4641-b12a-680daf8cf440] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:48.193221 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-c160bdd6-c0df-4263-84f2-f64f70875e48 req-e72c6bfc-3b11-47ac-9692-f45f9d853073 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c36d121-4610-4641-b12a-680daf8cf440", "tag": "1e026290-e0ea-4142-992c-806bce55dee6"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:37:48.200066 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-dea74825-62a6-4243-8380-1d89f4ecefb9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:48.200680 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-dea74825-62a6-4243-8380-1d89f4ecefb9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:48.201281 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-dea74825-62a6-4243-8380-1d89f4ecefb9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:48.202186 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-dea74825-62a6-4243-8380-1d89f4ecefb9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:48.202827 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-dea74825-62a6-4243-8380-1d89f4ecefb9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:48.203432 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-dea74825-62a6-4243-8380-1d89f4ecefb9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:48.205640 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-c160bdd6-c0df-4263-84f2-f64f70875e48 req-e72c6bfc-3b11-47ac-9692-f45f9d853073 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:48.206123 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-c160bdd6-c0df-4263-84f2-f64f70875e48 req-e72c6bfc-3b11-47ac-9692-f45f9d853073 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:48.206546 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-c160bdd6-c0df-4263-84f2-f64f70875e48 req-e72c6bfc-3b11-47ac-9692-f45f9d853073 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:48.219421 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-c160bdd6-c0df-4263-84f2-f64f70875e48 req-e72c6bfc-3b11-47ac-9692-f45f9d853073 service nova] Creating event network-changed:1e026290-e0ea-4142-992c-806bce55dee6 for instance 8c36d121-4610-4641-b12a-680daf8cf440 on hv-cinder-78481 Aug 12 01:37:48.227482 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-c160bdd6-c0df-4263-84f2-f64f70875e48 req-e72c6bfc-3b11-47ac-9692-f45f9d853073 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039047 Aug 12 01:37:48.228310 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 485/963] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 01:37:48.233273 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-dea74825-62a6-4243-8380-1d89f4ecefb9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: 8c36d121-4610-4641-b12a-680daf8cf440] Going to try to terminate instance {{(pid=120785) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 01:37:48.334383 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-dea74825-62a6-4243-8380-1d89f4ecefb9 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440" status: 204 len: 0 microversion: 2.1 time: 0.146556 Aug 12 01:37:48.336327 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 479/964] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 01:37:48 2022] DELETE /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 01:37:48.349262 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-cce644b7-75ca-4cd6-8e4b-a394fd4cc03f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:48.355327 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-cce644b7-75ca-4cd6-8e4b-a394fd4cc03f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: 8c36d121-4610-4641-b12a-680daf8cf440] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:48.363250 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cce644b7-75ca-4cd6-8e4b-a394fd4cc03f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:48.363770 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cce644b7-75ca-4cd6-8e4b-a394fd4cc03f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:48.364248 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cce644b7-75ca-4cd6-8e4b-a394fd4cc03f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:48.364945 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cce644b7-75ca-4cd6-8e4b-a394fd4cc03f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:48.365415 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cce644b7-75ca-4cd6-8e4b-a394fd4cc03f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:48.366073 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-cce644b7-75ca-4cd6-8e4b-a394fd4cc03f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:48.518279 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-cce644b7-75ca-4cd6-8e4b-a394fd4cc03f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:37:48.528225 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-cce644b7-75ca-4cd6-8e4b-a394fd4cc03f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440" status: 200 len: 1574 microversion: 2.1 time: 0.187054 Aug 12 01:37:48.529150 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 486/965] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:37:48 2022] GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440 => generated 1574 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:37:49.550988 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-4c623bfa-36a2-4058-88c6-7a114046aac3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:49.552250 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-4c623bfa-36a2-4058-88c6-7a114046aac3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: 8c36d121-4610-4641-b12a-680daf8cf440] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:49.561210 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4c623bfa-36a2-4058-88c6-7a114046aac3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:49.561696 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4c623bfa-36a2-4058-88c6-7a114046aac3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:49.562122 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4c623bfa-36a2-4058-88c6-7a114046aac3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:49.562939 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4c623bfa-36a2-4058-88c6-7a114046aac3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:49.563400 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4c623bfa-36a2-4058-88c6-7a114046aac3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:49.564085 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4c623bfa-36a2-4058-88c6-7a114046aac3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:49.701858 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-4c623bfa-36a2-4058-88c6-7a114046aac3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:37:49.705400 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:37:49.710557 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-4c623bfa-36a2-4058-88c6-7a114046aac3 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440" status: 200 len: 1574 microversion: 2.1 time: 0.164088 Aug 12 01:37:49.711190 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 480/966] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:37:49 2022] GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440 => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:37:50.732094 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-785b7eb9-e542-4b92-a058-5e5b71c3bc02 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:50.732891 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-785b7eb9-e542-4b92-a058-5e5b71c3bc02 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: 8c36d121-4610-4641-b12a-680daf8cf440] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:50.739710 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-785b7eb9-e542-4b92-a058-5e5b71c3bc02 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:50.740201 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-785b7eb9-e542-4b92-a058-5e5b71c3bc02 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:50.740624 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-785b7eb9-e542-4b92-a058-5e5b71c3bc02 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:50.741321 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-785b7eb9-e542-4b92-a058-5e5b71c3bc02 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:50.741777 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-785b7eb9-e542-4b92-a058-5e5b71c3bc02 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:50.742195 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-785b7eb9-e542-4b92-a058-5e5b71c3bc02 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:50.761882 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:37:50.890370 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-18094167-338f-4770-81a8-a744e6e80a0c req-70bb1130-8375-410d-b000-dad51b1690a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c36d121-4610-4641-b12a-680daf8cf440", "name": "network-vif-deleted", "tag": "1e026290-e0ea-4142-992c-806bce55dee6"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:37:50.895152 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-785b7eb9-e542-4b92-a058-5e5b71c3bc02 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:37:50.900821 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-18094167-338f-4770-81a8-a744e6e80a0c req-70bb1130-8375-410d-b000-dad51b1690a5 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:50.901308 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-18094167-338f-4770-81a8-a744e6e80a0c req-70bb1130-8375-410d-b000-dad51b1690a5 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:50.901717 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-18094167-338f-4770-81a8-a744e6e80a0c req-70bb1130-8375-410d-b000-dad51b1690a5 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:50.905637 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-785b7eb9-e542-4b92-a058-5e5b71c3bc02 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440" status: 200 len: 1457 microversion: 2.1 time: 0.177098 Aug 12 01:37:50.907043 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 487/967] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:37:50 2022] GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440 => generated 1457 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:37:50.916770 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-18094167-338f-4770-81a8-a744e6e80a0c req-70bb1130-8375-410d-b000-dad51b1690a5 service nova] Creating event network-vif-deleted:1e026290-e0ea-4142-992c-806bce55dee6 for instance 8c36d121-4610-4641-b12a-680daf8cf440 on hv-cinder-78481 Aug 12 01:37:50.921709 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-18094167-338f-4770-81a8-a744e6e80a0c req-70bb1130-8375-410d-b000-dad51b1690a5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035206 Aug 12 01:37:50.922334 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 481/968] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:37:51.926969 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-73fd40d2-aa66-4127-9bee-980b815ca0e1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:51.927569 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-73fd40d2-aa66-4127-9bee-980b815ca0e1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: 8c36d121-4610-4641-b12a-680daf8cf440] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:51.934890 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-73fd40d2-aa66-4127-9bee-980b815ca0e1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:51.935288 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-73fd40d2-aa66-4127-9bee-980b815ca0e1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:51.935754 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-73fd40d2-aa66-4127-9bee-980b815ca0e1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:51.936455 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-73fd40d2-aa66-4127-9bee-980b815ca0e1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:51.937028 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-73fd40d2-aa66-4127-9bee-980b815ca0e1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:51.937446 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-73fd40d2-aa66-4127-9bee-980b815ca0e1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:51.952190 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.wsgi [None req-73fd40d2-aa66-4127-9bee-980b815ca0e1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] HTTP exception thrown: Instance 8c36d121-4610-4641-b12a-680daf8cf440 could not be found. Aug 12 01:37:51.953903 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-73fd40d2-aa66-4127-9bee-980b815ca0e1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Request method failure captured: Aug 12 01:37:51.953903 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: request: GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440 HTTP/1.1 Aug 12 01:37:51.953903 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept: application/json Aug 12 01:37:51.953903 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept-Encoding: identity Aug 12 01:37:51.953903 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Connection: close Aug 12 01:37:51.953903 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Length: 0 Aug 12 01:37:51.953903 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Type: application/json Aug 12 01:37:51.953903 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Host: 10.222.0.20 Aug 12 01:37:51.953903 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Openstack-System-Scope: None Aug 12 01:37:51.953903 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: User-Agent: python-urllib3/1.26.11 Aug 12 01:37:51.953903 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Auth-Token: gAAAAABi9az6XUnea8vGoWh6UZfza72nNL9KxVqN40zelsPgomF7wuYQq-g1kWUnikeO9Qg4dkfiqeYMY_BAF2L7w258PS9fhVXpMUnegsFF4NRihcJz9YttSumIc0gtGNUiDO8FqNLCfwaE1whzIwgFTj3x8ZWuCi0cfOy3c-edHEX9XbD5DL4 Aug 12 01:37:51.953903 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Id: None Aug 12 01:37:51.953903 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Name: None Aug 12 01:37:51.953903 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Identity-Status: Confirmed Aug 12 01:37:51.953903 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Is-Admin-Project: True Aug 12 01:37:51.953903 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Id: default Aug 12 01:37:51.953903 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Name: Default Aug 12 01:37:51.953903 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Id: 2ca05e52a1c94aa7a8877ea34c412c95 Aug 12 01:37:51.953903 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Name: tempest-TestVolumeBootPattern-700529332 Aug 12 01:37:51.953903 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Role: member,reader Aug 12 01:37:51.953903 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Roles: member,reader Aug 12 01:37:51.955685 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2ca05e52a1c94aa7a8877ea34c412c95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ca05e52a1c94aa7a8877ea34c412c95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2ca05e52a1c94aa7a8877ea34c412c95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ca05e52a1c94aa7a8877ea34c412c95"}]}] Aug 12 01:37:51.955685 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant: tempest-TestVolumeBootPattern-700529332 Aug 12 01:37:51.955685 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Id: 2ca05e52a1c94aa7a8877ea34c412c95 Aug 12 01:37:51.955685 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Name: tempest-TestVolumeBootPattern-700529332 Aug 12 01:37:51.955685 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User: tempest-TestVolumeBootPattern-700529332-project Aug 12 01:37:51.955685 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Id: default Aug 12 01:37:51.955685 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Name: Default Aug 12 01:37:51.955685 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Id: 166e2f065c674cc0a6465f3d0d6bbb4d Aug 12 01:37:51.955685 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Name: tempest-TestVolumeBootPattern-700529332-project Aug 12 01:37:51.955685 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: method: > Aug 12 01:37:51.955685 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: exception: Instance 8c36d121-4610-4641-b12a-680daf8cf440 could not be found. Aug 12 01:37:51.955685 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: action_args: {'id': '8c36d121-4610-4641-b12a-680daf8cf440'} Aug 12 01:37:51.956610 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:37:51.956610 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:37:51.956610 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:37:51.956610 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:37:51.956610 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:37:51.956610 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:37:51.956610 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:37:51.956610 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:37:51.956610 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:37:51.956610 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:37:51.956610 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c36d121-4610-4641-b12a-680daf8cf440 could not be found. Aug 12 01:37:51.956610 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:37:51.956610 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:37:51.956610 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:37:51.956610 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:37:51.956610 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:37:51.956610 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:37:51.956610 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:37:51.956610 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:37:51.956610 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:37:51.958160 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:37:51.958160 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 01:37:51.958160 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 01:37:51.958160 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:37:51.958160 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:37:51.958160 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:37:51.958160 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:37:51.958160 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c36d121-4610-4641-b12a-680daf8cf440 could not be found. Aug 12 01:37:51.958160 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:37:51.958160 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:37:51.958160 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:37:51.958160 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:37:51.958160 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:37:51.958160 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:37:51.958160 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:37:51.958160 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:37:51.958160 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c36d121-4610-4641-b12a-680daf8cf440 could not be found. Aug 12 01:37:51.958160 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:37:51.959843 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-73fd40d2-aa66-4127-9bee-980b815ca0e1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Returning 404 to user: Instance 8c36d121-4610-4641-b12a-680daf8cf440 could not be found. {{(pid=120786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:37:51.959843 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-73fd40d2-aa66-4127-9bee-980b815ca0e1 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440" status: 404 len: 111 microversion: 2.1 time: 0.032669 Aug 12 01:37:51.959843 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 488/969] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:37:51 2022] GET /compute/v2.1/servers/8c36d121-4610-4641-b12a-680daf8cf440 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:37:57.582376 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-4376b071-59c3-466e-957a-b9252c006699 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:57.582891 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-bce6b497-58ba-46a7-b644-20ae4751025e req-8c646270-dacf-46d6-b8cd-073016313fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e61e785b-aa63-4b29-b82d-185988c73bc1", "tag": "7f3a189a-2823-4a1c-8884-bc1b49992c1c"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:37:57.583271 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-4376b071-59c3-466e-957a-b9252c006699 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: e61e785b-aa63-4b29-b82d-185988c73bc1] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:57.593412 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-bce6b497-58ba-46a7-b644-20ae4751025e req-8c646270-dacf-46d6-b8cd-073016313fa9 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:57.594346 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-bce6b497-58ba-46a7-b644-20ae4751025e req-8c646270-dacf-46d6-b8cd-073016313fa9 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:57.595036 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-bce6b497-58ba-46a7-b644-20ae4751025e req-8c646270-dacf-46d6-b8cd-073016313fa9 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:57.595483 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4376b071-59c3-466e-957a-b9252c006699 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:57.596019 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4376b071-59c3-466e-957a-b9252c006699 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:57.596712 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4376b071-59c3-466e-957a-b9252c006699 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:57.597759 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4376b071-59c3-466e-957a-b9252c006699 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:57.598372 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4376b071-59c3-466e-957a-b9252c006699 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:57.598952 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4376b071-59c3-466e-957a-b9252c006699 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:57.612056 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-bce6b497-58ba-46a7-b644-20ae4751025e req-8c646270-dacf-46d6-b8cd-073016313fa9 service nova] Creating event network-changed:7f3a189a-2823-4a1c-8884-bc1b49992c1c for instance e61e785b-aa63-4b29-b82d-185988c73bc1 on hv-cinder-78481 Aug 12 01:37:57.617783 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-bce6b497-58ba-46a7-b644-20ae4751025e req-8c646270-dacf-46d6-b8cd-073016313fa9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038626 Aug 12 01:37:57.623628 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 489/970] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 01:37:57.631097 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-4376b071-59c3-466e-957a-b9252c006699 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: e61e785b-aa63-4b29-b82d-185988c73bc1] Going to try to terminate instance {{(pid=120785) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 01:37:57.725950 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-4376b071-59c3-466e-957a-b9252c006699 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1" status: 204 len: 0 microversion: 2.1 time: 0.148961 Aug 12 01:37:57.726932 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 482/971] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 01:37:57 2022] DELETE /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 01:37:57.735685 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-eb143b03-53a4-428c-82f7-865f437d6db0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:57.737038 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-eb143b03-53a4-428c-82f7-865f437d6db0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: e61e785b-aa63-4b29-b82d-185988c73bc1] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:57.745194 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-eb143b03-53a4-428c-82f7-865f437d6db0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:57.747031 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-eb143b03-53a4-428c-82f7-865f437d6db0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:57.748075 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-eb143b03-53a4-428c-82f7-865f437d6db0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:57.749436 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-eb143b03-53a4-428c-82f7-865f437d6db0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:57.750095 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-eb143b03-53a4-428c-82f7-865f437d6db0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:57.750855 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-eb143b03-53a4-428c-82f7-865f437d6db0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:58.328617 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-eb143b03-53a4-428c-82f7-865f437d6db0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:37:58.340527 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-eb143b03-53a4-428c-82f7-865f437d6db0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1" status: 200 len: 1575 microversion: 2.1 time: 0.608807 Aug 12 01:37:58.341281 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 490/972] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:37:57 2022] GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1 => generated 1575 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 01:37:59.366651 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-853d6a1b-6409-4757-9e9a-a4dd4de3440f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:37:59.370873 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-853d6a1b-6409-4757-9e9a-a4dd4de3440f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: e61e785b-aa63-4b29-b82d-185988c73bc1] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:37:59.378054 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:37:59.379682 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-853d6a1b-6409-4757-9e9a-a4dd4de3440f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:59.380483 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-853d6a1b-6409-4757-9e9a-a4dd4de3440f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:59.381229 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-853d6a1b-6409-4757-9e9a-a4dd4de3440f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:59.382276 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-853d6a1b-6409-4757-9e9a-a4dd4de3440f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:37:59.382907 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-853d6a1b-6409-4757-9e9a-a4dd4de3440f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:37:59.383507 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-853d6a1b-6409-4757-9e9a-a4dd4de3440f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:37:59.656464 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-853d6a1b-6409-4757-9e9a-a4dd4de3440f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:37:59.664618 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-853d6a1b-6409-4757-9e9a-a4dd4de3440f tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1" status: 200 len: 1575 microversion: 2.1 time: 0.304877 Aug 12 01:37:59.673305 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 483/973] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:37:59 2022] GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1 => generated 1575 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:38:00.688426 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-a88f551c-c41d-4b70-b799-0d5d43131853 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:38:00.689291 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-a88f551c-c41d-4b70-b799-0d5d43131853 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: e61e785b-aa63-4b29-b82d-185988c73bc1] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:38:00.692439 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:38:00.700736 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a88f551c-c41d-4b70-b799-0d5d43131853 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:00.705108 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a88f551c-c41d-4b70-b799-0d5d43131853 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:00.705824 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a88f551c-c41d-4b70-b799-0d5d43131853 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:00.707707 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a88f551c-c41d-4b70-b799-0d5d43131853 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:00.709364 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a88f551c-c41d-4b70-b799-0d5d43131853 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:00.710034 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a88f551c-c41d-4b70-b799-0d5d43131853 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:01.123637 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-a88f551c-c41d-4b70-b799-0d5d43131853 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:38:01.135421 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-a88f551c-c41d-4b70-b799-0d5d43131853 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1" status: 200 len: 1575 microversion: 2.1 time: 0.449230 Aug 12 01:38:01.136562 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 491/974] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:38:00 2022] GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1 => generated 1575 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:38:01.936241 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-3ef7ee2e-0c6c-45e7-8370-9dfa39cd1e91 req-1c9a5dad-cd68-4247-b7bc-5a3f825ffbe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e61e785b-aa63-4b29-b82d-185988c73bc1", "name": "network-vif-deleted", "tag": "7f3a189a-2823-4a1c-8884-bc1b49992c1c"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:38:01.948701 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-3ef7ee2e-0c6c-45e7-8370-9dfa39cd1e91 req-1c9a5dad-cd68-4247-b7bc-5a3f825ffbe6 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:01.949484 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-3ef7ee2e-0c6c-45e7-8370-9dfa39cd1e91 req-1c9a5dad-cd68-4247-b7bc-5a3f825ffbe6 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:01.950102 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-3ef7ee2e-0c6c-45e7-8370-9dfa39cd1e91 req-1c9a5dad-cd68-4247-b7bc-5a3f825ffbe6 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:01.964521 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-3ef7ee2e-0c6c-45e7-8370-9dfa39cd1e91 req-1c9a5dad-cd68-4247-b7bc-5a3f825ffbe6 service nova] Creating event network-vif-deleted:7f3a189a-2823-4a1c-8884-bc1b49992c1c for instance e61e785b-aa63-4b29-b82d-185988c73bc1 on hv-cinder-78481 Aug 12 01:38:01.970743 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-3ef7ee2e-0c6c-45e7-8370-9dfa39cd1e91 req-1c9a5dad-cd68-4247-b7bc-5a3f825ffbe6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038974 Aug 12 01:38:01.972248 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 484/975] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:38:02.158263 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-24c9ba57-af20-4b19-8367-ff9aca003788 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:38:02.158979 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-24c9ba57-af20-4b19-8367-ff9aca003788 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: e61e785b-aa63-4b29-b82d-185988c73bc1] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:38:02.166590 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-24c9ba57-af20-4b19-8367-ff9aca003788 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:02.167275 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-24c9ba57-af20-4b19-8367-ff9aca003788 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:02.167760 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-24c9ba57-af20-4b19-8367-ff9aca003788 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:02.168467 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-24c9ba57-af20-4b19-8367-ff9aca003788 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:02.168928 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-24c9ba57-af20-4b19-8367-ff9aca003788 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:02.169333 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-24c9ba57-af20-4b19-8367-ff9aca003788 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:02.319010 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-24c9ba57-af20-4b19-8367-ff9aca003788 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166e2f065c674cc0a6465f3d0d6bbb4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ca05e52a1c94aa7a8877ea34c412c95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:38:02.326998 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-24c9ba57-af20-4b19-8367-ff9aca003788 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1" status: 200 len: 1224 microversion: 2.1 time: 0.173463 Aug 12 01:38:02.327608 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 492/976] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:38:02 2022] GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1 => generated 1224 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:38:03.253748 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-4b3d15e0-9449-408a-9dec-69c31a149f14 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Action: 'create', calling method: .version_select at 0x7f2dece74820>, body: {"keypair": {"name": "tempest-TestShelveInstance-1036399014", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9c0F56kCny9eA/D9oVx27Cw3s+qYx3rWattzQ3GuzsJZlC9jK7E/ZvfRFBTQUnmdkhqEchdlPZXyQIaqjRCZ3+JwN9vuHXk32TBDeQi7V20q50+/fN9h+bOn82/BLhpQ=="}} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:38:03.275175 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.quota [None req-4b3d15e0-9449-408a-9dec-69c31a149f14 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Getting quotas for project 29b8427c88df4709b8ff7e395d93f89d. Resources: {'key_pairs'} {{(pid=120785) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 01:38:03.280040 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.quota [None req-4b3d15e0-9449-408a-9dec-69c31a149f14 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Getting quotas for user 48ab248227c94fcfaece38eb39d46787 and project 29b8427c88df4709b8ff7e395d93f89d. Resources: {'key_pairs'} {{(pid=120785) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 01:38:03.303966 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-4b3d15e0-9449-408a-9dec-69c31a149f14 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.171898 Aug 12 01:38:03.304642 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 485/977] 10.222.0.20 () {60 vars in 1159 bytes} [Fri Aug 12 01:38:03 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:38:03.348988 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-80321960-6863-429c-8ff2-35b9802a6783 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:38:03.349595 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-80321960-6863-429c-8ff2-35b9802a6783 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: e61e785b-aa63-4b29-b82d-185988c73bc1] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:38:03.355827 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-80321960-6863-429c-8ff2-35b9802a6783 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:03.356554 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-80321960-6863-429c-8ff2-35b9802a6783 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:03.357889 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-80321960-6863-429c-8ff2-35b9802a6783 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:03.358956 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-80321960-6863-429c-8ff2-35b9802a6783 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:03.359404 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-80321960-6863-429c-8ff2-35b9802a6783 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:03.359847 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-80321960-6863-429c-8ff2-35b9802a6783 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:03.376972 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.wsgi [None req-80321960-6863-429c-8ff2-35b9802a6783 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] HTTP exception thrown: Instance e61e785b-aa63-4b29-b82d-185988c73bc1 could not be found. Aug 12 01:38:03.378648 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-80321960-6863-429c-8ff2-35b9802a6783 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Request method failure captured: Aug 12 01:38:03.378648 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: request: GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1 HTTP/1.1 Aug 12 01:38:03.378648 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept: application/json Aug 12 01:38:03.378648 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept-Encoding: identity Aug 12 01:38:03.378648 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Connection: close Aug 12 01:38:03.378648 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Length: 0 Aug 12 01:38:03.378648 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Type: application/json Aug 12 01:38:03.378648 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Host: 10.222.0.20 Aug 12 01:38:03.378648 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Openstack-System-Scope: None Aug 12 01:38:03.378648 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: User-Agent: python-urllib3/1.26.11 Aug 12 01:38:03.378648 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Auth-Token: gAAAAABi9az6XUnea8vGoWh6UZfza72nNL9KxVqN40zelsPgomF7wuYQq-g1kWUnikeO9Qg4dkfiqeYMY_BAF2L7w258PS9fhVXpMUnegsFF4NRihcJz9YttSumIc0gtGNUiDO8FqNLCfwaE1whzIwgFTj3x8ZWuCi0cfOy3c-edHEX9XbD5DL4 Aug 12 01:38:03.378648 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Id: None Aug 12 01:38:03.378648 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Name: None Aug 12 01:38:03.378648 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Identity-Status: Confirmed Aug 12 01:38:03.378648 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Is-Admin-Project: True Aug 12 01:38:03.378648 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Id: default Aug 12 01:38:03.378648 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Name: Default Aug 12 01:38:03.378648 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Id: 2ca05e52a1c94aa7a8877ea34c412c95 Aug 12 01:38:03.378648 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Name: tempest-TestVolumeBootPattern-700529332 Aug 12 01:38:03.378648 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Role: member,reader Aug 12 01:38:03.378648 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Roles: member,reader Aug 12 01:38:03.380432 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2ca05e52a1c94aa7a8877ea34c412c95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ca05e52a1c94aa7a8877ea34c412c95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2ca05e52a1c94aa7a8877ea34c412c95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ca05e52a1c94aa7a8877ea34c412c95"}]}] Aug 12 01:38:03.380432 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant: tempest-TestVolumeBootPattern-700529332 Aug 12 01:38:03.380432 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Id: 2ca05e52a1c94aa7a8877ea34c412c95 Aug 12 01:38:03.380432 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Name: tempest-TestVolumeBootPattern-700529332 Aug 12 01:38:03.380432 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User: tempest-TestVolumeBootPattern-700529332-project Aug 12 01:38:03.380432 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Id: default Aug 12 01:38:03.380432 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Name: Default Aug 12 01:38:03.380432 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Id: 166e2f065c674cc0a6465f3d0d6bbb4d Aug 12 01:38:03.380432 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Name: tempest-TestVolumeBootPattern-700529332-project Aug 12 01:38:03.380432 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: method: > Aug 12 01:38:03.380432 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: exception: Instance e61e785b-aa63-4b29-b82d-185988c73bc1 could not be found. Aug 12 01:38:03.380432 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: action_args: {'id': 'e61e785b-aa63-4b29-b82d-185988c73bc1'} Aug 12 01:38:03.384560 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:38:03.384560 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:38:03.384560 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:38:03.384560 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:38:03.384560 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:38:03.384560 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:38:03.384560 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:38:03.384560 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:38:03.384560 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:38:03.384560 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:38:03.384560 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e61e785b-aa63-4b29-b82d-185988c73bc1 could not be found. Aug 12 01:38:03.384560 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:38:03.384560 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:38:03.384560 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:38:03.384560 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:38:03.384560 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:38:03.384560 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:38:03.384560 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:38:03.384560 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:38:03.384560 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:38:03.386523 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:38:03.386523 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 01:38:03.386523 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 01:38:03.386523 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:38:03.386523 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:38:03.386523 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:38:03.386523 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:38:03.386523 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e61e785b-aa63-4b29-b82d-185988c73bc1 could not be found. Aug 12 01:38:03.386523 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:38:03.386523 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:38:03.386523 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:38:03.386523 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:38:03.386523 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:38:03.386523 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:38:03.386523 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:38:03.386523 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:38:03.386523 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e61e785b-aa63-4b29-b82d-185988c73bc1 could not be found. Aug 12 01:38:03.386523 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:38:03.388168 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-80321960-6863-429c-8ff2-35b9802a6783 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Returning 404 to user: Instance e61e785b-aa63-4b29-b82d-185988c73bc1 could not be found. {{(pid=120786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:38:03.388168 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-80321960-6863-429c-8ff2-35b9802a6783 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1" status: 404 len: 111 microversion: 2.1 time: 0.035511 Aug 12 01:38:03.388168 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 493/978] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:38:03 2022] GET /compute/v2.1/servers/e61e785b-aa63-4b29-b82d-185988c73bc1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:38:03.603149 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-9aa19805-d56c-4663-a511-7fd4bcefcfc8 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:38:03.603838 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-9aa19805-d56c-4663-a511-7fd4bcefcfc8 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: 691b5aff-f98b-4d30-86b9-70c933c401b9] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:38:03.611055 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9aa19805-d56c-4663-a511-7fd4bcefcfc8 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:03.611923 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9aa19805-d56c-4663-a511-7fd4bcefcfc8 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:03.612564 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9aa19805-d56c-4663-a511-7fd4bcefcfc8 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:03.613436 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9aa19805-d56c-4663-a511-7fd4bcefcfc8 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:03.613891 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9aa19805-d56c-4663-a511-7fd4bcefcfc8 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:03.614314 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9aa19805-d56c-4663-a511-7fd4bcefcfc8 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:03.714234 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.objects.instance [None req-9aa19805-d56c-4663-a511-7fd4bcefcfc8 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lazy-loading 'services' on Instance uuid 691b5aff-f98b-4d30-86b9-70c933c401b9 {{(pid=120785) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 01:38:03.826511 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-9aa19805-d56c-4663-a511-7fd4bcefcfc8 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] 10.222.0.20 "DELETE /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9/os-volume_attachments/b20fad31-dbc1-4de1-8dab-75cfb7c3b793" status: 202 len: 0 microversion: 2.1 time: 0.227479 Aug 12 01:38:03.827127 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 486/979] 10.222.0.20 () {58 vars in 1416 bytes} [Fri Aug 12 01:38:03 2022] DELETE /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9/os-volume_attachments/b20fad31-dbc1-4de1-8dab-75cfb7c3b793 => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 01:38:03.957884 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-9519b4af-6ccb-4294-baf2-90927c1419a0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:38:03.958306 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-9519b4af-6ccb-4294-baf2-90927c1419a0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: a8c75c35-1961-4c9b-9208-ed9096bf447d] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:38:03.966597 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9519b4af-6ccb-4294-baf2-90927c1419a0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:03.967090 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9519b4af-6ccb-4294-baf2-90927c1419a0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:03.967526 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9519b4af-6ccb-4294-baf2-90927c1419a0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:03.968993 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9519b4af-6ccb-4294-baf2-90927c1419a0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:03.969469 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9519b4af-6ccb-4294-baf2-90927c1419a0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:03.970283 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9519b4af-6ccb-4294-baf2-90927c1419a0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:03.986161 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.wsgi [None req-9519b4af-6ccb-4294-baf2-90927c1419a0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] HTTP exception thrown: Instance a8c75c35-1961-4c9b-9208-ed9096bf447d could not be found. Aug 12 01:38:03.988105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-9519b4af-6ccb-4294-baf2-90927c1419a0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Request method failure captured: Aug 12 01:38:03.988105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: request: DELETE /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d HTTP/1.1 Aug 12 01:38:03.988105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept: application/json Aug 12 01:38:03.988105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept-Encoding: identity Aug 12 01:38:03.988105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Connection: close Aug 12 01:38:03.988105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Length: 0 Aug 12 01:38:03.988105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Type: application/json Aug 12 01:38:03.988105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Host: 10.222.0.20 Aug 12 01:38:03.988105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Openstack-System-Scope: None Aug 12 01:38:03.988105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: User-Agent: python-urllib3/1.26.11 Aug 12 01:38:03.988105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Auth-Token: gAAAAABi9az6XUnea8vGoWh6UZfza72nNL9KxVqN40zelsPgomF7wuYQq-g1kWUnikeO9Qg4dkfiqeYMY_BAF2L7w258PS9fhVXpMUnegsFF4NRihcJz9YttSumIc0gtGNUiDO8FqNLCfwaE1whzIwgFTj3x8ZWuCi0cfOy3c-edHEX9XbD5DL4 Aug 12 01:38:03.988105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Id: None Aug 12 01:38:03.988105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Name: None Aug 12 01:38:03.988105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Identity-Status: Confirmed Aug 12 01:38:03.988105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Is-Admin-Project: True Aug 12 01:38:03.988105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Id: default Aug 12 01:38:03.988105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Name: Default Aug 12 01:38:03.988105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Id: 2ca05e52a1c94aa7a8877ea34c412c95 Aug 12 01:38:03.988105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Name: tempest-TestVolumeBootPattern-700529332 Aug 12 01:38:03.988105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Role: member,reader Aug 12 01:38:03.988105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Roles: member,reader Aug 12 01:38:03.989555 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2ca05e52a1c94aa7a8877ea34c412c95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ca05e52a1c94aa7a8877ea34c412c95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2ca05e52a1c94aa7a8877ea34c412c95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ca05e52a1c94aa7a8877ea34c412c95"}]}] Aug 12 01:38:03.989555 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant: tempest-TestVolumeBootPattern-700529332 Aug 12 01:38:03.989555 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Id: 2ca05e52a1c94aa7a8877ea34c412c95 Aug 12 01:38:03.989555 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Name: tempest-TestVolumeBootPattern-700529332 Aug 12 01:38:03.989555 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User: tempest-TestVolumeBootPattern-700529332-project Aug 12 01:38:03.989555 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Id: default Aug 12 01:38:03.989555 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Name: Default Aug 12 01:38:03.989555 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Id: 166e2f065c674cc0a6465f3d0d6bbb4d Aug 12 01:38:03.989555 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Name: tempest-TestVolumeBootPattern-700529332-project Aug 12 01:38:03.989555 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: method: > Aug 12 01:38:03.989555 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: exception: Instance a8c75c35-1961-4c9b-9208-ed9096bf447d could not be found. Aug 12 01:38:03.989555 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: action_args: {'id': 'a8c75c35-1961-4c9b-9208-ed9096bf447d'} Aug 12 01:38:03.990684 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:38:03.990684 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:38:03.990684 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:38:03.990684 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:38:03.990684 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:38:03.990684 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:38:03.990684 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:38:03.990684 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:38:03.990684 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:38:03.990684 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:38:03.990684 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8c75c35-1961-4c9b-9208-ed9096bf447d could not be found. Aug 12 01:38:03.990684 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:38:03.990684 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:38:03.990684 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:38:03.990684 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:38:03.990684 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:38:03.990684 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:38:03.990684 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:38:03.990684 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:38:03.990684 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:38:03.992095 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:38:03.992095 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 01:38:03.992095 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 01:38:03.992095 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 01:38:03.992095 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 01:38:03.992095 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:38:03.992095 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:38:03.992095 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:38:03.992095 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:38:03.992095 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8c75c35-1961-4c9b-9208-ed9096bf447d could not be found. Aug 12 01:38:03.992095 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:38:03.992095 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:38:03.992095 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:38:03.992095 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:38:03.992095 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:38:03.992095 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:38:03.992095 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:38:03.992095 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:38:03.992095 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8c75c35-1961-4c9b-9208-ed9096bf447d could not be found. Aug 12 01:38:03.992095 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:38:03.993664 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-9519b4af-6ccb-4294-baf2-90927c1419a0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Returning 404 to user: Instance a8c75c35-1961-4c9b-9208-ed9096bf447d could not be found. {{(pid=120786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:38:03.993664 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-9519b4af-6ccb-4294-baf2-90927c1419a0 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d" status: 404 len: 111 microversion: 2.1 time: 0.038933 Aug 12 01:38:03.993664 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 494/980] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 01:38:03 2022] DELETE /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:38:03.999947 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-cc1fedf4-e977-4b80-b970-a14653a76d96 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:38:04.000647 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-cc1fedf4-e977-4b80-b970-a14653a76d96 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [instance: a8c75c35-1961-4c9b-9208-ed9096bf447d] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:38:04.008165 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cc1fedf4-e977-4b80-b970-a14653a76d96 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:04.010818 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cc1fedf4-e977-4b80-b970-a14653a76d96 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:04.011754 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cc1fedf4-e977-4b80-b970-a14653a76d96 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:04.013056 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cc1fedf4-e977-4b80-b970-a14653a76d96 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:04.013727 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cc1fedf4-e977-4b80-b970-a14653a76d96 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:04.014341 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-cc1fedf4-e977-4b80-b970-a14653a76d96 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:04.037332 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.wsgi [None req-cc1fedf4-e977-4b80-b970-a14653a76d96 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] HTTP exception thrown: Instance a8c75c35-1961-4c9b-9208-ed9096bf447d could not be found. Aug 12 01:38:04.039008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-cc1fedf4-e977-4b80-b970-a14653a76d96 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Request method failure captured: Aug 12 01:38:04.039008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: request: GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d HTTP/1.1 Aug 12 01:38:04.039008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept: application/json Aug 12 01:38:04.039008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Accept-Encoding: identity Aug 12 01:38:04.039008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Connection: close Aug 12 01:38:04.039008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Length: 0 Aug 12 01:38:04.039008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Content-Type: application/json Aug 12 01:38:04.039008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Host: 10.222.0.20 Aug 12 01:38:04.039008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Openstack-System-Scope: None Aug 12 01:38:04.039008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: User-Agent: python-urllib3/1.26.11 Aug 12 01:38:04.039008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Auth-Token: gAAAAABi9az6XUnea8vGoWh6UZfza72nNL9KxVqN40zelsPgomF7wuYQq-g1kWUnikeO9Qg4dkfiqeYMY_BAF2L7w258PS9fhVXpMUnegsFF4NRihcJz9YttSumIc0gtGNUiDO8FqNLCfwaE1whzIwgFTj3x8ZWuCi0cfOy3c-edHEX9XbD5DL4 Aug 12 01:38:04.039008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Id: None Aug 12 01:38:04.039008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Domain-Name: None Aug 12 01:38:04.039008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Identity-Status: Confirmed Aug 12 01:38:04.039008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Is-Admin-Project: True Aug 12 01:38:04.039008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Id: default Aug 12 01:38:04.039008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Domain-Name: Default Aug 12 01:38:04.039008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Id: 2ca05e52a1c94aa7a8877ea34c412c95 Aug 12 01:38:04.039008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Project-Name: tempest-TestVolumeBootPattern-700529332 Aug 12 01:38:04.039008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Role: member,reader Aug 12 01:38:04.039008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Roles: member,reader Aug 12 01:38:04.040697 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2ca05e52a1c94aa7a8877ea34c412c95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ca05e52a1c94aa7a8877ea34c412c95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2ca05e52a1c94aa7a8877ea34c412c95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ca05e52a1c94aa7a8877ea34c412c95"}]}] Aug 12 01:38:04.040697 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant: tempest-TestVolumeBootPattern-700529332 Aug 12 01:38:04.040697 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Id: 2ca05e52a1c94aa7a8877ea34c412c95 Aug 12 01:38:04.040697 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-Tenant-Name: tempest-TestVolumeBootPattern-700529332 Aug 12 01:38:04.040697 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User: tempest-TestVolumeBootPattern-700529332-project Aug 12 01:38:04.040697 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Id: default Aug 12 01:38:04.040697 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Domain-Name: Default Aug 12 01:38:04.040697 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Id: 166e2f065c674cc0a6465f3d0d6bbb4d Aug 12 01:38:04.040697 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: X-User-Name: tempest-TestVolumeBootPattern-700529332-project Aug 12 01:38:04.040697 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: method: > Aug 12 01:38:04.040697 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: exception: Instance a8c75c35-1961-4c9b-9208-ed9096bf447d could not be found. Aug 12 01:38:04.040697 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: action_args: {'id': 'a8c75c35-1961-4c9b-9208-ed9096bf447d'} Aug 12 01:38:04.042072 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:38:04.042072 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:38:04.042072 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:38:04.042072 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:38:04.042072 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:38:04.042072 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:38:04.042072 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:38:04.042072 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:38:04.042072 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:38:04.042072 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:38:04.042072 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8c75c35-1961-4c9b-9208-ed9096bf447d could not be found. Aug 12 01:38:04.042072 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:38:04.042072 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:38:04.042072 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:38:04.042072 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:38:04.042072 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:38:04.042072 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:38:04.042072 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:38:04.042072 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:38:04.042072 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:38:04.043361 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:38:04.043361 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 01:38:04.043361 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 01:38:04.043361 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:38:04.043361 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:38:04.043361 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:38:04.043361 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:38:04.043361 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8c75c35-1961-4c9b-9208-ed9096bf447d could not be found. Aug 12 01:38:04.043361 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:38:04.043361 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:38:04.043361 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:38:04.043361 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:38:04.043361 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:38:04.043361 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:38:04.043361 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:38:04.043361 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:38:04.043361 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8c75c35-1961-4c9b-9208-ed9096bf447d could not be found. Aug 12 01:38:04.043361 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR nova.api.openstack.wsgi Aug 12 01:38:04.045304 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-cc1fedf4-e977-4b80-b970-a14653a76d96 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Returning 404 to user: Instance a8c75c35-1961-4c9b-9208-ed9096bf447d could not be found. {{(pid=120785) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:38:04.045304 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-cc1fedf4-e977-4b80-b970-a14653a76d96 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d" status: 404 len: 111 microversion: 2.1 time: 0.045156 Aug 12 01:38:04.045304 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 487/981] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:38:03 2022] GET /compute/v2.1/servers/a8c75c35-1961-4c9b-9208-ed9096bf447d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:38:04.990442 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-e78cd22d-1a88-4d10-af96-0aea3d693de5 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:38:04.991014 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-e78cd22d-1a88-4d10-af96-0aea3d693de5 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: 691b5aff-f98b-4d30-86b9-70c933c401b9] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:38:04.998223 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e78cd22d-1a88-4d10-af96-0aea3d693de5 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:04.998844 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e78cd22d-1a88-4d10-af96-0aea3d693de5 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:04.999332 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e78cd22d-1a88-4d10-af96-0aea3d693de5 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:05.000084 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e78cd22d-1a88-4d10-af96-0aea3d693de5 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:05.000514 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e78cd22d-1a88-4d10-af96-0aea3d693de5 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:05.000935 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e78cd22d-1a88-4d10-af96-0aea3d693de5 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:05.027335 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-e78cd22d-1a88-4d10-af96-0aea3d693de5 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: 691b5aff-f98b-4d30-86b9-70c933c401b9] Going to try to terminate instance {{(pid=120786) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 01:38:05.130606 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-e78cd22d-1a88-4d10-af96-0aea3d693de5 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] 10.222.0.20 "DELETE /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9" status: 204 len: 0 microversion: 2.1 time: 0.143666 Aug 12 01:38:05.131311 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 495/982] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 01:38:04 2022] DELETE /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 01:38:05.140777 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-02915477-c82e-40fb-9074-951f5299cb35 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:38:05.141419 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-02915477-c82e-40fb-9074-951f5299cb35 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: 691b5aff-f98b-4d30-86b9-70c933c401b9] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:38:05.151198 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-02915477-c82e-40fb-9074-951f5299cb35 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:05.152004 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-02915477-c82e-40fb-9074-951f5299cb35 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:05.152469 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-02915477-c82e-40fb-9074-951f5299cb35 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:05.153555 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-02915477-c82e-40fb-9074-951f5299cb35 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:05.154329 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-02915477-c82e-40fb-9074-951f5299cb35 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:05.155059 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-02915477-c82e-40fb-9074-951f5299cb35 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:05.322981 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-02915477-c82e-40fb-9074-951f5299cb35 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d94989669a458db647bd8344087efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c325ffbf006f4c8fa8ce5f370a157c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:38:05.330923 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-02915477-c82e-40fb-9074-951f5299cb35 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] 10.222.0.20 "GET /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9" status: 200 len: 1515 microversion: 2.1 time: 0.194306 Aug 12 01:38:05.332047 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 488/983] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:38:05 2022] GET /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9 => generated 1515 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:38:05.389844 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-13894984-b78d-4874-961f-eb80a7a09a44 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] Calling method '.version_select at 0x7f2decc4c040>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:38:05.394398 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR oslo.messaging._drivers.impl_rabbit [None req-13894984-b78d-4874-961f-eb80a7a09a44 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [368346b9-ed3f-4806-8b4c-6b969e05ee52] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 12 01:38:06.351846 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-55440949-99f2-4f4b-94a0-8d6d53a9d1db tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:38:06.352408 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-55440949-99f2-4f4b-94a0-8d6d53a9d1db tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: 691b5aff-f98b-4d30-86b9-70c933c401b9] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:38:06.359550 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-55440949-99f2-4f4b-94a0-8d6d53a9d1db tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:06.360091 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-55440949-99f2-4f4b-94a0-8d6d53a9d1db tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:06.360495 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-55440949-99f2-4f4b-94a0-8d6d53a9d1db tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:06.361203 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-55440949-99f2-4f4b-94a0-8d6d53a9d1db tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:06.361650 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-55440949-99f2-4f4b-94a0-8d6d53a9d1db tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:06.362079 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-55440949-99f2-4f4b-94a0-8d6d53a9d1db tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:06.402405 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO oslo.messaging._drivers.impl_rabbit [None req-13894984-b78d-4874-961f-eb80a7a09a44 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] [368346b9-ed3f-4806-8b4c-6b969e05ee52] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 49904. Aug 12 01:38:06.432142 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-13894984-b78d-4874-961f-eb80a7a09a44 tempest-TestVolumeBootPattern-700529332 tempest-TestVolumeBootPattern-700529332-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-140950627" status: 202 len: 0 microversion: 2.1 time: 1.046721 Aug 12 01:38:06.432744 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 496/984] 10.222.0.20 () {58 vars in 1260 bytes} [Fri Aug 12 01:38:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-140950627 => generated 0 bytes in 1048 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 01:38:06.850130 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-55440949-99f2-4f4b-94a0-8d6d53a9d1db tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d94989669a458db647bd8344087efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c325ffbf006f4c8fa8ce5f370a157c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:38:06.858748 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-55440949-99f2-4f4b-94a0-8d6d53a9d1db tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] 10.222.0.20 "GET /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9" status: 200 len: 1515 microversion: 2.1 time: 0.510970 Aug 12 01:38:06.859927 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 489/985] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:38:06 2022] GET /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9 => generated 1515 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:38:07.746773 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-2eb9b01a-e0a0-4a5d-91ea-3fc906762729 req-d0d7a512-51d9-41f4-8883-ecdb6a66333d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "691b5aff-f98b-4d30-86b9-70c933c401b9", "name": "network-vif-deleted", "tag": "1389ef99-7202-48fb-bea3-9376dc260d9c"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:38:07.761111 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-2eb9b01a-e0a0-4a5d-91ea-3fc906762729 req-d0d7a512-51d9-41f4-8883-ecdb6a66333d service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:07.761580 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-2eb9b01a-e0a0-4a5d-91ea-3fc906762729 req-d0d7a512-51d9-41f4-8883-ecdb6a66333d service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:07.762216 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-2eb9b01a-e0a0-4a5d-91ea-3fc906762729 req-d0d7a512-51d9-41f4-8883-ecdb6a66333d service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:07.775707 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-2eb9b01a-e0a0-4a5d-91ea-3fc906762729 req-d0d7a512-51d9-41f4-8883-ecdb6a66333d service nova] Creating event network-vif-deleted:1389ef99-7202-48fb-bea3-9376dc260d9c for instance 691b5aff-f98b-4d30-86b9-70c933c401b9 on hv-cinder-78481 Aug 12 01:38:07.781417 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-2eb9b01a-e0a0-4a5d-91ea-3fc906762729 req-d0d7a512-51d9-41f4-8883-ecdb6a66333d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038620 Aug 12 01:38:07.782366 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 497/986] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:38:07.880457 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-f637dbe4-6cee-425d-b7fc-845ec5e19ffe tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:38:07.881078 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-f637dbe4-6cee-425d-b7fc-845ec5e19ffe tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: 691b5aff-f98b-4d30-86b9-70c933c401b9] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:38:07.887878 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f637dbe4-6cee-425d-b7fc-845ec5e19ffe tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:07.888367 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f637dbe4-6cee-425d-b7fc-845ec5e19ffe tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:07.888801 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f637dbe4-6cee-425d-b7fc-845ec5e19ffe tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:07.889502 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f637dbe4-6cee-425d-b7fc-845ec5e19ffe tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:07.889943 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f637dbe4-6cee-425d-b7fc-845ec5e19ffe tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:07.890362 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f637dbe4-6cee-425d-b7fc-845ec5e19ffe tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:07.923206 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f637dbe4-6cee-425d-b7fc-845ec5e19ffe tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:07.923975 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f637dbe4-6cee-425d-b7fc-845ec5e19ffe tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:07.924412 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-f637dbe4-6cee-425d-b7fc-845ec5e19ffe tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:07.924867 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.objects.instance [None req-f637dbe4-6cee-425d-b7fc-845ec5e19ffe tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lazy-loading 'fault' on Instance uuid 691b5aff-f98b-4d30-86b9-70c933c401b9 {{(pid=120785) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 01:38:07.966000 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-f637dbe4-6cee-425d-b7fc-845ec5e19ffe tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83d94989669a458db647bd8344087efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c325ffbf006f4c8fa8ce5f370a157c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:38:07.975404 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-f637dbe4-6cee-425d-b7fc-845ec5e19ffe tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] 10.222.0.20 "GET /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9" status: 200 len: 1309 microversion: 2.1 time: 0.098987 Aug 12 01:38:07.976110 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 490/987] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:38:07 2022] GET /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9 => generated 1309 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:38:08.997253 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-7d97a194-462a-481c-9077-cff1bccca624 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:38:08.999802 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-7d97a194-462a-481c-9077-cff1bccca624 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] [instance: 691b5aff-f98b-4d30-86b9-70c933c401b9] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:38:09.006843 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7d97a194-462a-481c-9077-cff1bccca624 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:09.007344 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7d97a194-462a-481c-9077-cff1bccca624 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:09.007996 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7d97a194-462a-481c-9077-cff1bccca624 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:09.008701 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7d97a194-462a-481c-9077-cff1bccca624 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:09.009175 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7d97a194-462a-481c-9077-cff1bccca624 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:09.009597 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7d97a194-462a-481c-9077-cff1bccca624 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:09.032438 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.wsgi [None req-7d97a194-462a-481c-9077-cff1bccca624 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] HTTP exception thrown: Instance 691b5aff-f98b-4d30-86b9-70c933c401b9 could not be found. Aug 12 01:38:09.034467 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-7d97a194-462a-481c-9077-cff1bccca624 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Request method failure captured: Aug 12 01:38:09.034467 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: request: GET /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9 HTTP/1.1 Aug 12 01:38:09.034467 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept: application/json Aug 12 01:38:09.034467 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept-Encoding: identity Aug 12 01:38:09.034467 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Connection: close Aug 12 01:38:09.034467 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Length: 0 Aug 12 01:38:09.034467 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Type: application/json Aug 12 01:38:09.034467 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Host: 10.222.0.20 Aug 12 01:38:09.034467 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Openstack-System-Scope: None Aug 12 01:38:09.034467 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: User-Agent: python-urllib3/1.26.11 Aug 12 01:38:09.034467 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Auth-Token: gAAAAABi9a6C72nVRYhLMvm41KnczxSW7aSbVSaDWldASgVKDW8lGnE1dBtRHl7L5fGjoR5qUTbnxmjYZHmDAbYeVNgUr_cWA4CaRWKAwztIx27WnJ9IdxuKZBqMCCz6YM3p8FLc7tkTpqfZlpfHPD03Bco59RUabi-kipAsFsKS2WRKYZQkawA Aug 12 01:38:09.034467 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Id: None Aug 12 01:38:09.034467 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Name: None Aug 12 01:38:09.034467 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Identity-Status: Confirmed Aug 12 01:38:09.034467 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Is-Admin-Project: True Aug 12 01:38:09.034467 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Id: default Aug 12 01:38:09.034467 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Name: Default Aug 12 01:38:09.034467 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Id: c325ffbf006f4c8fa8ce5f370a157c02 Aug 12 01:38:09.034467 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1025844362 Aug 12 01:38:09.034467 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Role: member,reader Aug 12 01:38:09.034467 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Roles: member,reader Aug 12 01:38:09.036172 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c325ffbf006f4c8fa8ce5f370a157c02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c325ffbf006f4c8fa8ce5f370a157c02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c325ffbf006f4c8fa8ce5f370a157c02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c325ffbf006f4c8fa8ce5f370a157c02"}]}] Aug 12 01:38:09.036172 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant: tempest-VolumesSnapshotTestJSON-1025844362 Aug 12 01:38:09.036172 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Id: c325ffbf006f4c8fa8ce5f370a157c02 Aug 12 01:38:09.036172 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1025844362 Aug 12 01:38:09.036172 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User: tempest-VolumesSnapshotTestJSON-1025844362-project Aug 12 01:38:09.036172 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Id: default Aug 12 01:38:09.036172 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Name: Default Aug 12 01:38:09.036172 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Id: 83d94989669a458db647bd8344087efa Aug 12 01:38:09.036172 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Name: tempest-VolumesSnapshotTestJSON-1025844362-project Aug 12 01:38:09.036172 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: method: > Aug 12 01:38:09.036172 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: exception: Instance 691b5aff-f98b-4d30-86b9-70c933c401b9 could not be found. Aug 12 01:38:09.036172 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: action_args: {'id': '691b5aff-f98b-4d30-86b9-70c933c401b9'} Aug 12 01:38:09.037105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:38:09.037105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:38:09.037105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:38:09.037105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:38:09.037105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:38:09.037105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:38:09.037105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:38:09.037105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:38:09.037105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:38:09.037105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:38:09.037105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 691b5aff-f98b-4d30-86b9-70c933c401b9 could not be found. Aug 12 01:38:09.037105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:38:09.037105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:38:09.037105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:38:09.037105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:38:09.037105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:38:09.037105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:38:09.037105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:38:09.037105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:38:09.037105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:38:09.038392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:38:09.038392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 01:38:09.038392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 01:38:09.038392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:38:09.038392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:38:09.038392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:38:09.038392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:38:09.038392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 691b5aff-f98b-4d30-86b9-70c933c401b9 could not be found. Aug 12 01:38:09.038392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:38:09.038392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:38:09.038392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:38:09.038392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:38:09.038392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:38:09.038392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:38:09.038392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:38:09.038392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:38:09.038392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 691b5aff-f98b-4d30-86b9-70c933c401b9 could not be found. Aug 12 01:38:09.038392 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:38:09.041069 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-7d97a194-462a-481c-9077-cff1bccca624 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] Returning 404 to user: Instance 691b5aff-f98b-4d30-86b9-70c933c401b9 could not be found. {{(pid=120786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:38:09.041069 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-7d97a194-462a-481c-9077-cff1bccca624 tempest-VolumesSnapshotTestJSON-1025844362 tempest-VolumesSnapshotTestJSON-1025844362-project] 10.222.0.20 "GET /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9" status: 404 len: 111 microversion: 2.1 time: 0.043172 Aug 12 01:38:09.041069 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 498/988] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:38:08 2022] GET /compute/v2.1/servers/691b5aff-f98b-4d30-86b9-70c933c401b9 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:38:19.949268 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-90e4f855-1149-4bad-bf20-81a995182adc tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2110794361", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1036399014", "security_groups": [{"name": "tempest-secgroup-smoke-695564097"}], "networks": [{"uuid": "61d18213-79ef-43c0-aba3-bb18141f4096"}], "block_device_mapping_v2": [{"uuid": "1746bb06-aa31-44db-85f4-cddcde3a16df", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:38:19.959309 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell0:SELECT=4 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:38:19.960069 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:38:19.960706 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:38:20.075219 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.network.neutron [None req-90e4f855-1149-4bad-bf20-81a995182adc tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] validate_networks() for [('61d18213-79ef-43c0-aba3-bb18141f4096', None, None, None, None, None)] {{(pid=120785) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 01:38:20.137365 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 01:38:20.137572 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Fri Aug 12 01:38:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.20) !!! Aug 12 01:38:20.465846 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-90e4f855-1149-4bad-bf20-81a995182adc tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Flavor limits 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 01:38:20.466341 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-90e4f855-1149-4bad-bf20-81a995182adc tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Image limits 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 01:38:20.466990 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-90e4f855-1149-4bad-bf20-81a995182adc tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Flavor pref 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 01:38:20.467504 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-90e4f855-1149-4bad-bf20-81a995182adc tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Image pref 0:0:0 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 01:38:20.468123 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.virt.hardware [None req-90e4f855-1149-4bad-bf20-81a995182adc tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120785) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 01:38:20.480913 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-90e4f855-1149-4bad-bf20-81a995182adc tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:20.481393 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-90e4f855-1149-4bad-bf20-81a995182adc tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:20.481829 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-90e4f855-1149-4bad-bf20-81a995182adc tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:20.482552 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-90e4f855-1149-4bad-bf20-81a995182adc tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:20.483003 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-90e4f855-1149-4bad-bf20-81a995182adc tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:20.483426 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-90e4f855-1149-4bad-bf20-81a995182adc tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:20.500643 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.quota [None req-90e4f855-1149-4bad-bf20-81a995182adc tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Getting quotas for project 29b8427c88df4709b8ff7e395d93f89d. Resources: {'cores', 'ram', 'instances'} {{(pid=120785) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 01:38:20.505013 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.quota [None req-90e4f855-1149-4bad-bf20-81a995182adc tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Getting quotas for user 48ab248227c94fcfaece38eb39d46787 and project 29b8427c88df4709b8ff7e395d93f89d. Resources: {'cores', 'ram', 'instances'} {{(pid=120785) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 01:38:20.570475 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-90e4f855-1149-4bad-bf20-81a995182adc tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Going to run 1 instances... {{(pid=120785) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 01:38:20.572593 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-90e4f855-1149-4bad-bf20-81a995182adc tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1746bb06-aa31-44db-85f4-cddcde3a16df',volume_size=None,volume_type=None)] {{(pid=120785) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 01:38:20.715219 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-90e4f855-1149-4bad-bf20-81a995182adc tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.769856 Aug 12 01:38:20.716018 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 491/989] 10.222.0.20 () {60 vars in 1147 bytes} [Fri Aug 12 01:38:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 01:38:20.728480 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-7ea7ac1f-9919-4557-bac3-977e1dc40e6a tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:38:20.729381 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-7ea7ac1f-9919-4557-bac3-977e1dc40e6a tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:38:20.733056 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:38:20.734121 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:38:20.790786 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-7ea7ac1f-9919-4557-bac3-977e1dc40e6a tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ab248227c94fcfaece38eb39d46787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b8427c88df4709b8ff7e395d93f89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:38:20.798787 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-7ea7ac1f-9919-4557-bac3-977e1dc40e6a tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 200 len: 1089 microversion: 2.1 time: 0.075585 Aug 12 01:38:20.799412 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 499/990] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:38:20 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 1089 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:38:21.823855 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-6aad98ec-0fd8-45fe-afe0-72cdb0094d2d tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:38:21.824789 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-6aad98ec-0fd8-45fe-afe0-72cdb0094d2d tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:38:21.835569 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6aad98ec-0fd8-45fe-afe0-72cdb0094d2d tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:21.836369 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6aad98ec-0fd8-45fe-afe0-72cdb0094d2d tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:21.837080 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6aad98ec-0fd8-45fe-afe0-72cdb0094d2d tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:21.838198 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6aad98ec-0fd8-45fe-afe0-72cdb0094d2d tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:21.838936 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6aad98ec-0fd8-45fe-afe0-72cdb0094d2d tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:21.839660 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6aad98ec-0fd8-45fe-afe0-72cdb0094d2d tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:21.901865 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-6aad98ec-0fd8-45fe-afe0-72cdb0094d2d tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ab248227c94fcfaece38eb39d46787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b8427c88df4709b8ff7e395d93f89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:38:21.909647 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-6aad98ec-0fd8-45fe-afe0-72cdb0094d2d tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 200 len: 1139 microversion: 2.1 time: 0.093170 Aug 12 01:38:21.910200 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 492/991] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:38:21 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 1139 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:38:22.929865 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-16f511b2-28da-4ef7-9b92-d1a844269fc5 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:38:22.931220 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-16f511b2-28da-4ef7-9b92-d1a844269fc5 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:38:22.938475 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-16f511b2-28da-4ef7-9b92-d1a844269fc5 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:22.939083 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-16f511b2-28da-4ef7-9b92-d1a844269fc5 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:22.939665 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-16f511b2-28da-4ef7-9b92-d1a844269fc5 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:22.940405 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-16f511b2-28da-4ef7-9b92-d1a844269fc5 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:22.940853 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-16f511b2-28da-4ef7-9b92-d1a844269fc5 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:22.941276 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-16f511b2-28da-4ef7-9b92-d1a844269fc5 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:23.017516 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-16f511b2-28da-4ef7-9b92-d1a844269fc5 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ab248227c94fcfaece38eb39d46787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b8427c88df4709b8ff7e395d93f89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:38:23.026158 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-16f511b2-28da-4ef7-9b92-d1a844269fc5 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 200 len: 1205 microversion: 2.1 time: 0.100265 Aug 12 01:38:23.027365 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 500/992] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:38:22 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 1205 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:38:23.881353 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-8b6e96a8-a5ee-4bce-ad80-69b366bc1acb req-f163439a-8e98-4410-89de-ee167b2564c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58cf9e5c-f472-4561-86d1-8957f7a46e76", "tag": "c51c81c0-090a-4ff7-af49-a4ffd522196b"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:38:23.891497 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-8b6e96a8-a5ee-4bce-ad80-69b366bc1acb req-f163439a-8e98-4410-89de-ee167b2564c5 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:23.891930 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-8b6e96a8-a5ee-4bce-ad80-69b366bc1acb req-f163439a-8e98-4410-89de-ee167b2564c5 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:23.892354 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-8b6e96a8-a5ee-4bce-ad80-69b366bc1acb req-f163439a-8e98-4410-89de-ee167b2564c5 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:23.903446 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-8b6e96a8-a5ee-4bce-ad80-69b366bc1acb req-f163439a-8e98-4410-89de-ee167b2564c5 service nova] Creating event network-changed:c51c81c0-090a-4ff7-af49-a4ffd522196b for instance 58cf9e5c-f472-4561-86d1-8957f7a46e76 on hv-cinder-78481 Aug 12 01:38:23.908413 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-8b6e96a8-a5ee-4bce-ad80-69b366bc1acb req-f163439a-8e98-4410-89de-ee167b2564c5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031081 Aug 12 01:38:23.909169 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 493/993] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:38:24.054520 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-c6478118-69ec-4df1-bbeb-16da35326959 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:38:24.055128 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-c6478118-69ec-4df1-bbeb-16da35326959 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:38:24.061802 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c6478118-69ec-4df1-bbeb-16da35326959 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:24.062276 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c6478118-69ec-4df1-bbeb-16da35326959 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:24.062705 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c6478118-69ec-4df1-bbeb-16da35326959 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:24.063375 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c6478118-69ec-4df1-bbeb-16da35326959 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:24.063842 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c6478118-69ec-4df1-bbeb-16da35326959 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:24.064254 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c6478118-69ec-4df1-bbeb-16da35326959 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:24.209662 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-c6478118-69ec-4df1-bbeb-16da35326959 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ab248227c94fcfaece38eb39d46787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b8427c88df4709b8ff7e395d93f89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:38:24.218010 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-c6478118-69ec-4df1-bbeb-16da35326959 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 200 len: 1260 microversion: 2.1 time: 0.167371 Aug 12 01:38:24.218682 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 501/994] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:38:24 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:38:25.244493 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-897f3c03-699d-408b-91c3-f5cdff536401 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:38:25.245468 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-897f3c03-699d-408b-91c3-f5cdff536401 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:38:25.253434 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-897f3c03-699d-408b-91c3-f5cdff536401 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:25.253913 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-897f3c03-699d-408b-91c3-f5cdff536401 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:25.254343 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-897f3c03-699d-408b-91c3-f5cdff536401 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:25.255025 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-897f3c03-699d-408b-91c3-f5cdff536401 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:25.255469 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-897f3c03-699d-408b-91c3-f5cdff536401 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:25.255929 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-897f3c03-699d-408b-91c3-f5cdff536401 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:25.400831 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-897f3c03-699d-408b-91c3-f5cdff536401 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ab248227c94fcfaece38eb39d46787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b8427c88df4709b8ff7e395d93f89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:38:25.409146 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-897f3c03-699d-408b-91c3-f5cdff536401 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 200 len: 1260 microversion: 2.1 time: 0.172796 Aug 12 01:38:25.409715 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 494/995] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:38:25 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:38:26.430615 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-4d25131b-71a5-4a7f-9206-5f48466e1749 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:38:26.431201 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-4d25131b-71a5-4a7f-9206-5f48466e1749 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:38:26.438145 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4d25131b-71a5-4a7f-9206-5f48466e1749 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:26.438614 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4d25131b-71a5-4a7f-9206-5f48466e1749 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:26.439031 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4d25131b-71a5-4a7f-9206-5f48466e1749 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:26.439748 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4d25131b-71a5-4a7f-9206-5f48466e1749 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:26.440191 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4d25131b-71a5-4a7f-9206-5f48466e1749 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:26.440599 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-4d25131b-71a5-4a7f-9206-5f48466e1749 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:26.574856 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-4d25131b-71a5-4a7f-9206-5f48466e1749 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ab248227c94fcfaece38eb39d46787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b8427c88df4709b8ff7e395d93f89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:38:26.582563 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-4d25131b-71a5-4a7f-9206-5f48466e1749 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 200 len: 1260 microversion: 2.1 time: 0.155921 Aug 12 01:38:26.583128 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 502/996] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:38:26 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:38:27.607627 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-3264d7f4-d546-4482-a05b-4d775be8b63e tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:38:27.608611 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-3264d7f4-d546-4482-a05b-4d775be8b63e tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:38:27.619752 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3264d7f4-d546-4482-a05b-4d775be8b63e tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:27.620501 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3264d7f4-d546-4482-a05b-4d775be8b63e tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:27.621258 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3264d7f4-d546-4482-a05b-4d775be8b63e tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:27.622376 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3264d7f4-d546-4482-a05b-4d775be8b63e tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:27.623121 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3264d7f4-d546-4482-a05b-4d775be8b63e tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:27.623874 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3264d7f4-d546-4482-a05b-4d775be8b63e tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:27.759332 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-3264d7f4-d546-4482-a05b-4d775be8b63e tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ab248227c94fcfaece38eb39d46787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b8427c88df4709b8ff7e395d93f89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:38:27.767215 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-3264d7f4-d546-4482-a05b-4d775be8b63e tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 200 len: 1260 microversion: 2.1 time: 0.166192 Aug 12 01:38:27.767821 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 495/997] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:38:27 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:38:28.791838 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-082cc3d7-9d68-4de2-9242-9ed69eb3adae tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:38:28.792847 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-082cc3d7-9d68-4de2-9242-9ed69eb3adae tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:38:28.802485 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-082cc3d7-9d68-4de2-9242-9ed69eb3adae tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:28.802971 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-082cc3d7-9d68-4de2-9242-9ed69eb3adae tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:28.803404 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-082cc3d7-9d68-4de2-9242-9ed69eb3adae tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:28.804128 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-082cc3d7-9d68-4de2-9242-9ed69eb3adae tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:28.804578 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-082cc3d7-9d68-4de2-9242-9ed69eb3adae tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:28.805001 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-082cc3d7-9d68-4de2-9242-9ed69eb3adae tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:28.953813 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-082cc3d7-9d68-4de2-9242-9ed69eb3adae tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ab248227c94fcfaece38eb39d46787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b8427c88df4709b8ff7e395d93f89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:38:28.962028 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-082cc3d7-9d68-4de2-9242-9ed69eb3adae tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 200 len: 1260 microversion: 2.1 time: 0.176775 Aug 12 01:38:28.962592 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 503/998] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:38:28 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:38:29.982821 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-683b596e-7b76-47bd-894c-7b0f86b78a6e tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:38:29.983487 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-683b596e-7b76-47bd-894c-7b0f86b78a6e tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:38:29.990674 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-683b596e-7b76-47bd-894c-7b0f86b78a6e tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:29.991177 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-683b596e-7b76-47bd-894c-7b0f86b78a6e tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:29.991652 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-683b596e-7b76-47bd-894c-7b0f86b78a6e tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:29.992341 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-683b596e-7b76-47bd-894c-7b0f86b78a6e tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:29.992789 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-683b596e-7b76-47bd-894c-7b0f86b78a6e tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:29.993209 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-683b596e-7b76-47bd-894c-7b0f86b78a6e tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:30.133048 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-683b596e-7b76-47bd-894c-7b0f86b78a6e tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ab248227c94fcfaece38eb39d46787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b8427c88df4709b8ff7e395d93f89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:38:30.140751 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-683b596e-7b76-47bd-894c-7b0f86b78a6e tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 200 len: 1260 microversion: 2.1 time: 0.162006 Aug 12 01:38:30.141314 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 496/999] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:38:29 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:38:31.164865 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-350b4010-ffef-45d7-83e6-e93881b7738f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:38:31.165385 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-350b4010-ffef-45d7-83e6-e93881b7738f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:38:31.167810 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell0:SELECT=2 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:38:31.173964 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-350b4010-ffef-45d7-83e6-e93881b7738f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:31.174443 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-350b4010-ffef-45d7-83e6-e93881b7738f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:31.174872 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-350b4010-ffef-45d7-83e6-e93881b7738f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:31.175564 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-350b4010-ffef-45d7-83e6-e93881b7738f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:31.176040 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-350b4010-ffef-45d7-83e6-e93881b7738f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:31.176459 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-350b4010-ffef-45d7-83e6-e93881b7738f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:31.308512 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-350b4010-ffef-45d7-83e6-e93881b7738f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ab248227c94fcfaece38eb39d46787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b8427c88df4709b8ff7e395d93f89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:38:31.317688 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-350b4010-ffef-45d7-83e6-e93881b7738f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 200 len: 1260 microversion: 2.1 time: 0.158567 Aug 12 01:38:31.318266 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 504/1000] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:38:31 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:38:32.342580 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-ce134571-cbba-4fbb-bbe0-cf78fd2f2095 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:38:32.343523 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-ce134571-cbba-4fbb-bbe0-cf78fd2f2095 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:38:32.346622 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell0:SELECT=2 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:38:32.347759 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell0:SELECT=6 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:38:32.358512 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ce134571-cbba-4fbb-bbe0-cf78fd2f2095 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:32.359310 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ce134571-cbba-4fbb-bbe0-cf78fd2f2095 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:32.360148 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ce134571-cbba-4fbb-bbe0-cf78fd2f2095 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:32.362102 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ce134571-cbba-4fbb-bbe0-cf78fd2f2095 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:32.362102 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ce134571-cbba-4fbb-bbe0-cf78fd2f2095 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:32.362757 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-ce134571-cbba-4fbb-bbe0-cf78fd2f2095 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:32.788427 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-ce134571-cbba-4fbb-bbe0-cf78fd2f2095 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ab248227c94fcfaece38eb39d46787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b8427c88df4709b8ff7e395d93f89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:38:32.796379 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-ce134571-cbba-4fbb-bbe0-cf78fd2f2095 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 200 len: 1260 microversion: 2.1 time: 0.460588 Aug 12 01:38:32.796982 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 497/1001] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:38:32 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 1260 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:38:33.817400 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-7fcbc852-2b57-471e-837d-4d7afffa3c8f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:38:33.818069 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-7fcbc852-2b57-471e-837d-4d7afffa3c8f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:38:33.825335 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7fcbc852-2b57-471e-837d-4d7afffa3c8f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:33.825826 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7fcbc852-2b57-471e-837d-4d7afffa3c8f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:33.826256 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7fcbc852-2b57-471e-837d-4d7afffa3c8f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:33.826968 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7fcbc852-2b57-471e-837d-4d7afffa3c8f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:33.827415 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7fcbc852-2b57-471e-837d-4d7afffa3c8f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:33.827875 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7fcbc852-2b57-471e-837d-4d7afffa3c8f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:33.972003 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-7fcbc852-2b57-471e-837d-4d7afffa3c8f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ab248227c94fcfaece38eb39d46787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b8427c88df4709b8ff7e395d93f89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:38:33.979865 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-7fcbc852-2b57-471e-837d-4d7afffa3c8f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 200 len: 1260 microversion: 2.1 time: 0.166458 Aug 12 01:38:33.980485 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 505/1002] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:38:33 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:38:34.836526 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-fb7dd9b2-4fa0-4ca8-a5ab-b24a2700bd45 req-aca8e884-73e3-4eb8-bdd2-733539f7ee2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58cf9e5c-f472-4561-86d1-8957f7a46e76", "name": "network-vif-plugged", "status": "completed", "tag": "c51c81c0-090a-4ff7-af49-a4ffd522196b"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:38:34.847782 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-fb7dd9b2-4fa0-4ca8-a5ab-b24a2700bd45 req-aca8e884-73e3-4eb8-bdd2-733539f7ee2b service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:34.848858 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-fb7dd9b2-4fa0-4ca8-a5ab-b24a2700bd45 req-aca8e884-73e3-4eb8-bdd2-733539f7ee2b service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:34.849287 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-fb7dd9b2-4fa0-4ca8-a5ab-b24a2700bd45 req-aca8e884-73e3-4eb8-bdd2-733539f7ee2b service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:34.861620 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-fb7dd9b2-4fa0-4ca8-a5ab-b24a2700bd45 req-aca8e884-73e3-4eb8-bdd2-733539f7ee2b service nova] Creating event network-vif-plugged:c51c81c0-090a-4ff7-af49-a4ffd522196b for instance 58cf9e5c-f472-4561-86d1-8957f7a46e76 on hv-cinder-78481 Aug 12 01:38:34.866694 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-fb7dd9b2-4fa0-4ca8-a5ab-b24a2700bd45 req-aca8e884-73e3-4eb8-bdd2-733539f7ee2b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033969 Aug 12 01:38:34.867270 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 498/1003] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:38:35.000476 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-7e1e3570-a44c-4f0f-8c9d-22b03fbdac92 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:38:35.001166 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-7e1e3570-a44c-4f0f-8c9d-22b03fbdac92 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:38:35.007821 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7e1e3570-a44c-4f0f-8c9d-22b03fbdac92 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:35.008462 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7e1e3570-a44c-4f0f-8c9d-22b03fbdac92 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:35.008899 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7e1e3570-a44c-4f0f-8c9d-22b03fbdac92 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:35.009677 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7e1e3570-a44c-4f0f-8c9d-22b03fbdac92 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:35.010126 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7e1e3570-a44c-4f0f-8c9d-22b03fbdac92 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:35.010549 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-7e1e3570-a44c-4f0f-8c9d-22b03fbdac92 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:35.146157 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-7e1e3570-a44c-4f0f-8c9d-22b03fbdac92 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ab248227c94fcfaece38eb39d46787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b8427c88df4709b8ff7e395d93f89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:38:35.153741 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-7e1e3570-a44c-4f0f-8c9d-22b03fbdac92 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 200 len: 1260 microversion: 2.1 time: 0.157264 Aug 12 01:38:35.154336 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 506/1004] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:38:34 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:38:36.178906 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-3a4ba0a0-6528-40af-9fe2-663ae7eeffdc tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:38:36.179874 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-3a4ba0a0-6528-40af-9fe2-663ae7eeffdc tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:38:36.187834 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3a4ba0a0-6528-40af-9fe2-663ae7eeffdc tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:36.188314 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3a4ba0a0-6528-40af-9fe2-663ae7eeffdc tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:36.188746 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3a4ba0a0-6528-40af-9fe2-663ae7eeffdc tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:36.189449 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3a4ba0a0-6528-40af-9fe2-663ae7eeffdc tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:36.189897 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3a4ba0a0-6528-40af-9fe2-663ae7eeffdc tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:36.190316 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3a4ba0a0-6528-40af-9fe2-663ae7eeffdc tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:36.342100 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-3a4ba0a0-6528-40af-9fe2-663ae7eeffdc tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ab248227c94fcfaece38eb39d46787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b8427c88df4709b8ff7e395d93f89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:38:36.352951 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-3a4ba0a0-6528-40af-9fe2-663ae7eeffdc tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 200 len: 1444 microversion: 2.1 time: 0.181209 Aug 12 01:38:36.360356 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 499/1005] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:38:36 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 1444 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:38:36.373837 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-dccf1faf-61d5-4c54-b9c1-39c95bf98408 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:38:36.374454 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-dccf1faf-61d5-4c54-b9c1-39c95bf98408 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:38:36.381012 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dccf1faf-61d5-4c54-b9c1-39c95bf98408 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:36.381492 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dccf1faf-61d5-4c54-b9c1-39c95bf98408 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:36.381926 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dccf1faf-61d5-4c54-b9c1-39c95bf98408 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:36.382616 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dccf1faf-61d5-4c54-b9c1-39c95bf98408 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:36.383064 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dccf1faf-61d5-4c54-b9c1-39c95bf98408 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:36.383484 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-dccf1faf-61d5-4c54-b9c1-39c95bf98408 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:36.531174 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-dccf1faf-61d5-4c54-b9c1-39c95bf98408 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ab248227c94fcfaece38eb39d46787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b8427c88df4709b8ff7e395d93f89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:38:36.541332 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-dccf1faf-61d5-4c54-b9c1-39c95bf98408 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 200 len: 1444 microversion: 2.1 time: 0.171436 Aug 12 01:38:36.541880 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 507/1006] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:38:36 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 1444 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:38:38.778058 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [req-0a73ac91-799e-451b-a411-678264137a63 req-4db4c9f5-290d-4e6d-9c5c-371b72b4ed82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58cf9e5c-f472-4561-86d1-8957f7a46e76", "tag": "c51c81c0-090a-4ff7-af49-a4ffd522196b"}]} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:38:38.790524 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-0a73ac91-799e-451b-a411-678264137a63 req-4db4c9f5-290d-4e6d-9c5c-371b72b4ed82 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:38:38.790916 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-0a73ac91-799e-451b-a411-678264137a63 req-4db4c9f5-290d-4e6d-9c5c-371b72b4ed82 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:38:38.791468 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [req-0a73ac91-799e-451b-a411-678264137a63 req-4db4c9f5-290d-4e6d-9c5c-371b72b4ed82 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:38:38.806126 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.compute.server_external_events [req-0a73ac91-799e-451b-a411-678264137a63 req-4db4c9f5-290d-4e6d-9c5c-371b72b4ed82 service nova] Creating event network-changed:c51c81c0-090a-4ff7-af49-a4ffd522196b for instance 58cf9e5c-f472-4561-86d1-8957f7a46e76 on hv-cinder-78481 Aug 12 01:38:38.813380 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [req-0a73ac91-799e-451b-a411-678264137a63 req-4db4c9f5-290d-4e6d-9c5c-371b72b4ed82 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183210 Aug 12 01:38:38.814317 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 500/1007] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:40:34.028219 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR oslo.messaging._drivers.impl_rabbit [-] [51f664bb-0f43-4949-b55b-beec79119ab9] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 12 01:40:34.029575 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_api:SELECT=20 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:40:34.030756 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell1:SELECT=48 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:40:34.037647 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-e51496e3-d7c4-44de-9581-64558c37ac1d tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:40:34.038510 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-e51496e3-d7c4-44de-9581-64558c37ac1d tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:40:34.048759 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e51496e3-d7c4-44de-9581-64558c37ac1d tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:34.049220 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e51496e3-d7c4-44de-9581-64558c37ac1d tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:34.049663 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e51496e3-d7c4-44de-9581-64558c37ac1d tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:34.050344 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e51496e3-d7c4-44de-9581-64558c37ac1d tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:34.050785 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e51496e3-d7c4-44de-9581-64558c37ac1d tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:34.051199 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e51496e3-d7c4-44de-9581-64558c37ac1d tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:34.073909 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.objects.instance [None req-e51496e3-d7c4-44de-9581-64558c37ac1d tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lazy-loading 'flavor' on Instance uuid 58cf9e5c-f472-4561-86d1-8957f7a46e76 {{(pid=120786) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 01:40:34.152172 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-e51496e3-d7c4-44de-9581-64558c37ac1d tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "POST /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76/action" status: 202 len: 0 microversion: 2.1 time: 0.126654 Aug 12 01:40:34.152751 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 508/1008] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Aug 12 01:40:34 2022] POST /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 01:40:34.160726 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR oslo.messaging._drivers.impl_rabbit [-] [676a8585-7668-4dfc-a214-b13099d5b098] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 12 01:40:34.161434 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:40:34.162161 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell1:SELECT=44 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:40:34.166723 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-28b784ef-0c25-4ef9-b8a7-0bf06cc131c5 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:40:34.167405 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-28b784ef-0c25-4ef9-b8a7-0bf06cc131c5 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:40:34.175393 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-28b784ef-0c25-4ef9-b8a7-0bf06cc131c5 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:34.175983 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-28b784ef-0c25-4ef9-b8a7-0bf06cc131c5 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:34.176488 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-28b784ef-0c25-4ef9-b8a7-0bf06cc131c5 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:34.177539 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-28b784ef-0c25-4ef9-b8a7-0bf06cc131c5 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:34.178001 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-28b784ef-0c25-4ef9-b8a7-0bf06cc131c5 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:34.178416 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-28b784ef-0c25-4ef9-b8a7-0bf06cc131c5 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:34.316576 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-28b784ef-0c25-4ef9-b8a7-0bf06cc131c5 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ab248227c94fcfaece38eb39d46787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b8427c88df4709b8ff7e395d93f89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:40:34.325042 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-28b784ef-0c25-4ef9-b8a7-0bf06cc131c5 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 200 len: 1569 microversion: 2.1 time: 0.166523 Aug 12 01:40:34.325593 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 501/1009] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:40:34 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:40:35.351645 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-e7930586-4fba-43e2-abd1-e418b4bdaf12 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:40:35.352490 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-e7930586-4fba-43e2-abd1-e418b4bdaf12 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:40:35.362158 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e7930586-4fba-43e2-abd1-e418b4bdaf12 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:35.362733 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e7930586-4fba-43e2-abd1-e418b4bdaf12 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:35.363318 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e7930586-4fba-43e2-abd1-e418b4bdaf12 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:35.364369 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e7930586-4fba-43e2-abd1-e418b4bdaf12 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:35.364900 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e7930586-4fba-43e2-abd1-e418b4bdaf12 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:35.365396 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-e7930586-4fba-43e2-abd1-e418b4bdaf12 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:35.372074 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO oslo.messaging._drivers.impl_rabbit [-] [51f664bb-0f43-4949-b55b-beec79119ab9] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50238. Aug 12 01:40:35.505999 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-e7930586-4fba-43e2-abd1-e418b4bdaf12 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ab248227c94fcfaece38eb39d46787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b8427c88df4709b8ff7e395d93f89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:40:35.516384 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-e7930586-4fba-43e2-abd1-e418b4bdaf12 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 200 len: 1569 microversion: 2.1 time: 0.171636 Aug 12 01:40:35.517012 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 509/1010] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:40:35 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:40:36.548338 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-640f3540-b37c-4b07-9277-32421445b6e6 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:40:36.548925 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-640f3540-b37c-4b07-9277-32421445b6e6 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:40:36.557117 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-640f3540-b37c-4b07-9277-32421445b6e6 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:36.557645 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-640f3540-b37c-4b07-9277-32421445b6e6 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:36.558084 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-640f3540-b37c-4b07-9277-32421445b6e6 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:36.558746 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-640f3540-b37c-4b07-9277-32421445b6e6 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:36.559192 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-640f3540-b37c-4b07-9277-32421445b6e6 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:36.559633 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-640f3540-b37c-4b07-9277-32421445b6e6 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:36.565108 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO oslo.messaging._drivers.impl_rabbit [-] [676a8585-7668-4dfc-a214-b13099d5b098] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50242. Aug 12 01:40:36.705171 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-640f3540-b37c-4b07-9277-32421445b6e6 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ab248227c94fcfaece38eb39d46787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b8427c88df4709b8ff7e395d93f89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:40:36.713773 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-640f3540-b37c-4b07-9277-32421445b6e6 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 200 len: 1569 microversion: 2.1 time: 0.171867 Aug 12 01:40:36.714338 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 502/1011] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:40:36 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:40:37.737458 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-f34be8e5-21fd-4677-9a94-8c3997e1463f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:40:37.738097 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-f34be8e5-21fd-4677-9a94-8c3997e1463f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:40:37.744834 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f34be8e5-21fd-4677-9a94-8c3997e1463f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:37.745318 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f34be8e5-21fd-4677-9a94-8c3997e1463f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:37.745749 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f34be8e5-21fd-4677-9a94-8c3997e1463f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:37.746440 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f34be8e5-21fd-4677-9a94-8c3997e1463f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:37.746888 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f34be8e5-21fd-4677-9a94-8c3997e1463f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:37.747308 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-f34be8e5-21fd-4677-9a94-8c3997e1463f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:37.878924 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-f34be8e5-21fd-4677-9a94-8c3997e1463f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ab248227c94fcfaece38eb39d46787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b8427c88df4709b8ff7e395d93f89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:40:37.886790 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-f34be8e5-21fd-4677-9a94-8c3997e1463f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 200 len: 1569 microversion: 2.1 time: 0.154639 Aug 12 01:40:37.887364 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 510/1012] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:40:37 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:40:38.914893 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-fb15f7cc-6e71-4248-9a48-2583e1b61367 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:40:38.915906 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-fb15f7cc-6e71-4248-9a48-2583e1b61367 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:40:38.927168 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-fb15f7cc-6e71-4248-9a48-2583e1b61367 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:38.928052 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-fb15f7cc-6e71-4248-9a48-2583e1b61367 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:38.928792 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-fb15f7cc-6e71-4248-9a48-2583e1b61367 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:38.929916 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-fb15f7cc-6e71-4248-9a48-2583e1b61367 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:38.930663 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-fb15f7cc-6e71-4248-9a48-2583e1b61367 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:38.931359 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-fb15f7cc-6e71-4248-9a48-2583e1b61367 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:39.072111 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-fb15f7cc-6e71-4248-9a48-2583e1b61367 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ab248227c94fcfaece38eb39d46787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b8427c88df4709b8ff7e395d93f89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:40:39.083557 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-fb15f7cc-6e71-4248-9a48-2583e1b61367 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 200 len: 1569 microversion: 2.1 time: 0.175120 Aug 12 01:40:39.084288 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 503/1013] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:40:38 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:40:40.112140 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-9ea04c8c-e49a-46ad-aec7-213ba86bc597 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:40:40.112785 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-9ea04c8c-e49a-46ad-aec7-213ba86bc597 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:40:40.119742 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9ea04c8c-e49a-46ad-aec7-213ba86bc597 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:40.120160 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9ea04c8c-e49a-46ad-aec7-213ba86bc597 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:40.120585 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9ea04c8c-e49a-46ad-aec7-213ba86bc597 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:40.121274 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9ea04c8c-e49a-46ad-aec7-213ba86bc597 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:40.121719 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9ea04c8c-e49a-46ad-aec7-213ba86bc597 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:40.122133 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9ea04c8c-e49a-46ad-aec7-213ba86bc597 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:40.254415 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-9ea04c8c-e49a-46ad-aec7-213ba86bc597 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ab248227c94fcfaece38eb39d46787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b8427c88df4709b8ff7e395d93f89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:40:40.262723 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-9ea04c8c-e49a-46ad-aec7-213ba86bc597 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 200 len: 1569 microversion: 2.1 time: 0.156932 Aug 12 01:40:40.263258 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 511/1014] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:40:40 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:40:41.284747 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-6305ae22-aa58-468c-a085-bab767a6af5f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:40:41.285394 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-6305ae22-aa58-468c-a085-bab767a6af5f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:40:41.292902 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6305ae22-aa58-468c-a085-bab767a6af5f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:41.293431 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6305ae22-aa58-468c-a085-bab767a6af5f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:41.293906 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6305ae22-aa58-468c-a085-bab767a6af5f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:41.294670 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6305ae22-aa58-468c-a085-bab767a6af5f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:41.295176 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6305ae22-aa58-468c-a085-bab767a6af5f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:41.295638 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6305ae22-aa58-468c-a085-bab767a6af5f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:41.438927 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-6305ae22-aa58-468c-a085-bab767a6af5f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ab248227c94fcfaece38eb39d46787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b8427c88df4709b8ff7e395d93f89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:40:41.448065 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-6305ae22-aa58-468c-a085-bab767a6af5f tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 200 len: 1569 microversion: 2.1 time: 0.167522 Aug 12 01:40:41.448633 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 504/1015] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:40:41 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:40:42.473497 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-095143b4-e052-4665-a963-f88f07b92026 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:40:42.474504 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-095143b4-e052-4665-a963-f88f07b92026 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:40:42.485287 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-095143b4-e052-4665-a963-f88f07b92026 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:42.486081 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-095143b4-e052-4665-a963-f88f07b92026 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:42.486785 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-095143b4-e052-4665-a963-f88f07b92026 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:42.487476 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-095143b4-e052-4665-a963-f88f07b92026 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:42.487961 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-095143b4-e052-4665-a963-f88f07b92026 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:42.488382 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-095143b4-e052-4665-a963-f88f07b92026 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:42.626047 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-095143b4-e052-4665-a963-f88f07b92026 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ab248227c94fcfaece38eb39d46787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b8427c88df4709b8ff7e395d93f89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:40:42.633948 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-095143b4-e052-4665-a963-f88f07b92026 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 200 len: 1569 microversion: 2.1 time: 0.167055 Aug 12 01:40:42.634513 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 512/1016] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:40:42 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:40:43.659334 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-4c6c3d1e-9b1b-4f44-a78b-d1255ba894c6 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:40:43.660392 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-4c6c3d1e-9b1b-4f44-a78b-d1255ba894c6 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:40:43.668099 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4c6c3d1e-9b1b-4f44-a78b-d1255ba894c6 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:43.668630 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4c6c3d1e-9b1b-4f44-a78b-d1255ba894c6 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:43.669099 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4c6c3d1e-9b1b-4f44-a78b-d1255ba894c6 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:43.669858 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4c6c3d1e-9b1b-4f44-a78b-d1255ba894c6 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:43.670349 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4c6c3d1e-9b1b-4f44-a78b-d1255ba894c6 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:43.670812 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-4c6c3d1e-9b1b-4f44-a78b-d1255ba894c6 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:43.811867 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-4c6c3d1e-9b1b-4f44-a78b-d1255ba894c6 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ab248227c94fcfaece38eb39d46787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b8427c88df4709b8ff7e395d93f89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:40:43.819886 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-4c6c3d1e-9b1b-4f44-a78b-d1255ba894c6 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 200 len: 1569 microversion: 2.1 time: 0.167212 Aug 12 01:40:43.820447 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 505/1017] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:40:43 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:40:44.840954 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-9e1dc3cf-c9a9-431c-903d-6183317e04bc tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:40:44.842296 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-9e1dc3cf-c9a9-431c-903d-6183317e04bc tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:40:44.849473 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9e1dc3cf-c9a9-431c-903d-6183317e04bc tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:44.849961 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9e1dc3cf-c9a9-431c-903d-6183317e04bc tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:44.850398 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9e1dc3cf-c9a9-431c-903d-6183317e04bc tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:44.851072 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9e1dc3cf-c9a9-431c-903d-6183317e04bc tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:44.851574 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9e1dc3cf-c9a9-431c-903d-6183317e04bc tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:44.852013 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9e1dc3cf-c9a9-431c-903d-6183317e04bc tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:44.997319 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-9e1dc3cf-c9a9-431c-903d-6183317e04bc tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ab248227c94fcfaece38eb39d46787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b8427c88df4709b8ff7e395d93f89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:40:45.005674 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-9e1dc3cf-c9a9-431c-903d-6183317e04bc tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 200 len: 1569 microversion: 2.1 time: 0.168621 Aug 12 01:40:45.006242 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 513/1018] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:40:44 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:40:46.031124 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-611939fe-870b-4889-8573-76c2da1d9467 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:40:46.032157 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-611939fe-870b-4889-8573-76c2da1d9467 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:40:46.043472 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-611939fe-870b-4889-8573-76c2da1d9467 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:46.044336 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-611939fe-870b-4889-8573-76c2da1d9467 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:46.045059 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-611939fe-870b-4889-8573-76c2da1d9467 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:46.046243 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-611939fe-870b-4889-8573-76c2da1d9467 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:46.047002 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-611939fe-870b-4889-8573-76c2da1d9467 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:46.047754 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-611939fe-870b-4889-8573-76c2da1d9467 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:46.199401 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-611939fe-870b-4889-8573-76c2da1d9467 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ab248227c94fcfaece38eb39d46787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b8427c88df4709b8ff7e395d93f89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:40:46.210183 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-611939fe-870b-4889-8573-76c2da1d9467 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 200 len: 1569 microversion: 2.1 time: 0.185896 Aug 12 01:40:46.210751 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 506/1019] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:40:46 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:40:47.231781 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-9f0659d9-bdf4-40aa-bbdf-f9538dd6ad2d tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:40:47.232403 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-9f0659d9-bdf4-40aa-bbdf-f9538dd6ad2d tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:40:47.239287 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9f0659d9-bdf4-40aa-bbdf-f9538dd6ad2d tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:47.239796 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9f0659d9-bdf4-40aa-bbdf-f9538dd6ad2d tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:47.240223 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9f0659d9-bdf4-40aa-bbdf-f9538dd6ad2d tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:47.240909 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9f0659d9-bdf4-40aa-bbdf-f9538dd6ad2d tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:47.241354 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9f0659d9-bdf4-40aa-bbdf-f9538dd6ad2d tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:47.241768 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9f0659d9-bdf4-40aa-bbdf-f9538dd6ad2d tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:47.385944 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-9f0659d9-bdf4-40aa-bbdf-f9538dd6ad2d tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ab248227c94fcfaece38eb39d46787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b8427c88df4709b8ff7e395d93f89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:40:47.393891 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-9f0659d9-bdf4-40aa-bbdf-f9538dd6ad2d tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 200 len: 1510 microversion: 2.1 time: 0.166375 Aug 12 01:40:47.394459 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 514/1020] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:40:47 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:40:47.413791 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-29025a5b-ec0f-4770-8d02-9cc5b38f609c tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:40:47.414375 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-29025a5b-ec0f-4770-8d02-9cc5b38f609c tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:40:47.421146 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-29025a5b-ec0f-4770-8d02-9cc5b38f609c tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:47.421623 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-29025a5b-ec0f-4770-8d02-9cc5b38f609c tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:47.422049 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-29025a5b-ec0f-4770-8d02-9cc5b38f609c tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:47.422725 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-29025a5b-ec0f-4770-8d02-9cc5b38f609c tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:47.423173 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-29025a5b-ec0f-4770-8d02-9cc5b38f609c tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:47.423584 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-29025a5b-ec0f-4770-8d02-9cc5b38f609c tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:47.524387 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-29025a5b-ec0f-4770-8d02-9cc5b38f609c tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120785) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 12 01:40:47.601486 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-29025a5b-ec0f-4770-8d02-9cc5b38f609c tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "POST /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76/action" status: 202 len: 0 microversion: 2.1 time: 0.191608 Aug 12 01:40:47.602104 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 507/1021] 10.222.0.20 () {60 vars in 1278 bytes} [Fri Aug 12 01:40:47 2022] POST /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 01:40:47.610504 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-a2f7014b-cec0-4333-a943-98e6e68cf80b tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:40:47.611117 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-a2f7014b-cec0-4333-a943-98e6e68cf80b tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:40:47.617443 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a2f7014b-cec0-4333-a943-98e6e68cf80b tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:47.617924 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a2f7014b-cec0-4333-a943-98e6e68cf80b tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:47.618352 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a2f7014b-cec0-4333-a943-98e6e68cf80b tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:47.619043 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a2f7014b-cec0-4333-a943-98e6e68cf80b tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:47.619499 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a2f7014b-cec0-4333-a943-98e6e68cf80b tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:47.619998 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-a2f7014b-cec0-4333-a943-98e6e68cf80b tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:47.759857 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-a2f7014b-cec0-4333-a943-98e6e68cf80b tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ab248227c94fcfaece38eb39d46787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b8427c88df4709b8ff7e395d93f89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:40:47.768180 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-a2f7014b-cec0-4333-a943-98e6e68cf80b tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 200 len: 1518 microversion: 2.1 time: 0.161702 Aug 12 01:40:47.768997 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 515/1022] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:40:47 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:40:48.790762 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-267b3559-95a6-4eb6-b889-59da4ebd1aae tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:40:48.791411 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-267b3559-95a6-4eb6-b889-59da4ebd1aae tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:40:48.797947 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-267b3559-95a6-4eb6-b889-59da4ebd1aae tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:48.798444 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-267b3559-95a6-4eb6-b889-59da4ebd1aae tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:48.798885 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-267b3559-95a6-4eb6-b889-59da4ebd1aae tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:48.799636 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-267b3559-95a6-4eb6-b889-59da4ebd1aae tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:48.800117 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-267b3559-95a6-4eb6-b889-59da4ebd1aae tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:48.800765 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-267b3559-95a6-4eb6-b889-59da4ebd1aae tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:48.950610 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-267b3559-95a6-4eb6-b889-59da4ebd1aae tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ab248227c94fcfaece38eb39d46787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b8427c88df4709b8ff7e395d93f89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:40:48.960744 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-267b3559-95a6-4eb6-b889-59da4ebd1aae tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 200 len: 1576 microversion: 2.1 time: 0.174806 Aug 12 01:40:48.961317 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 508/1023] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:40:48 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:40:49.263586 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-70f45c2b-c6a9-4b87-9626-e9bce72920eb req-d775bd95-7bba-411d-b35d-2bfbdd000701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58cf9e5c-f472-4561-86d1-8957f7a46e76", "name": "network-vif-unplugged", "status": "completed", "tag": "c51c81c0-090a-4ff7-af49-a4ffd522196b"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:40:49.273817 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-70f45c2b-c6a9-4b87-9626-e9bce72920eb req-d775bd95-7bba-411d-b35d-2bfbdd000701 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:49.274305 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-70f45c2b-c6a9-4b87-9626-e9bce72920eb req-d775bd95-7bba-411d-b35d-2bfbdd000701 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:49.274948 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-70f45c2b-c6a9-4b87-9626-e9bce72920eb req-d775bd95-7bba-411d-b35d-2bfbdd000701 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:49.288202 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-70f45c2b-c6a9-4b87-9626-e9bce72920eb req-d775bd95-7bba-411d-b35d-2bfbdd000701 service nova] Creating event network-vif-unplugged:c51c81c0-090a-4ff7-af49-a4ffd522196b for instance 58cf9e5c-f472-4561-86d1-8957f7a46e76 on hv-cinder-78481 Aug 12 01:40:49.294591 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-70f45c2b-c6a9-4b87-9626-e9bce72920eb req-d775bd95-7bba-411d-b35d-2bfbdd000701 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100728 Aug 12 01:40:49.295239 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 516/1024] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:40:49.993686 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-3ceacf84-4bde-4db4-a7c0-42d19c42a843 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:40:49.994645 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-3ceacf84-4bde-4db4-a7c0-42d19c42a843 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:40:50.005390 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3ceacf84-4bde-4db4-a7c0-42d19c42a843 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:50.006177 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3ceacf84-4bde-4db4-a7c0-42d19c42a843 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:50.007056 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3ceacf84-4bde-4db4-a7c0-42d19c42a843 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:50.008473 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3ceacf84-4bde-4db4-a7c0-42d19c42a843 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:50.010008 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3ceacf84-4bde-4db4-a7c0-42d19c42a843 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:50.011289 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-3ceacf84-4bde-4db4-a7c0-42d19c42a843 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:50.155226 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-3ceacf84-4bde-4db4-a7c0-42d19c42a843 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ab248227c94fcfaece38eb39d46787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b8427c88df4709b8ff7e395d93f89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:40:50.163516 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-3ceacf84-4bde-4db4-a7c0-42d19c42a843 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 200 len: 1576 microversion: 2.1 time: 0.176469 Aug 12 01:40:50.164107 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 509/1025] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:40:49 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:40:51.190388 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-c4fbbc37-faeb-4781-8dd4-a52fd2f45074 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:40:51.191480 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-c4fbbc37-faeb-4781-8dd4-a52fd2f45074 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:40:51.202096 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c4fbbc37-faeb-4781-8dd4-a52fd2f45074 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:51.203028 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c4fbbc37-faeb-4781-8dd4-a52fd2f45074 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:51.203840 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c4fbbc37-faeb-4781-8dd4-a52fd2f45074 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:51.204980 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c4fbbc37-faeb-4781-8dd4-a52fd2f45074 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:51.205721 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c4fbbc37-faeb-4781-8dd4-a52fd2f45074 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:51.206413 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c4fbbc37-faeb-4781-8dd4-a52fd2f45074 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:51.345390 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-c4fbbc37-faeb-4781-8dd4-a52fd2f45074 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ab248227c94fcfaece38eb39d46787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b8427c88df4709b8ff7e395d93f89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:40:51.353322 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-c4fbbc37-faeb-4781-8dd4-a52fd2f45074 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 200 len: 1576 microversion: 2.1 time: 0.170949 Aug 12 01:40:51.353883 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 517/1026] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:40:51 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:40:52.378392 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-87e27cb5-e01a-4fce-be53-e3cd2c5e4ab3 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:40:52.381233 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-87e27cb5-e01a-4fce-be53-e3cd2c5e4ab3 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:40:52.386733 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-87e27cb5-e01a-4fce-be53-e3cd2c5e4ab3 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:52.387215 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-87e27cb5-e01a-4fce-be53-e3cd2c5e4ab3 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:52.387776 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-87e27cb5-e01a-4fce-be53-e3cd2c5e4ab3 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:52.388471 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-87e27cb5-e01a-4fce-be53-e3cd2c5e4ab3 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:52.388916 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-87e27cb5-e01a-4fce-be53-e3cd2c5e4ab3 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:52.389333 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-87e27cb5-e01a-4fce-be53-e3cd2c5e4ab3 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:52.527893 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-87e27cb5-e01a-4fce-be53-e3cd2c5e4ab3 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ab248227c94fcfaece38eb39d46787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b8427c88df4709b8ff7e395d93f89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:40:52.536155 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-87e27cb5-e01a-4fce-be53-e3cd2c5e4ab3 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 200 len: 1576 microversion: 2.1 time: 0.164215 Aug 12 01:40:52.536756 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 510/1027] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:40:52 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:40:53.557980 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-5431d705-221e-4fd6-9b27-294f94fed38e tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:40:53.558567 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-5431d705-221e-4fd6-9b27-294f94fed38e tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:40:53.565443 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5431d705-221e-4fd6-9b27-294f94fed38e tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:53.565919 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5431d705-221e-4fd6-9b27-294f94fed38e tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:53.566343 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5431d705-221e-4fd6-9b27-294f94fed38e tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:53.567032 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5431d705-221e-4fd6-9b27-294f94fed38e tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:53.567479 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5431d705-221e-4fd6-9b27-294f94fed38e tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:53.567922 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-5431d705-221e-4fd6-9b27-294f94fed38e tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:53.700999 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-5431d705-221e-4fd6-9b27-294f94fed38e tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ab248227c94fcfaece38eb39d46787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b8427c88df4709b8ff7e395d93f89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:40:53.708808 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-5431d705-221e-4fd6-9b27-294f94fed38e tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 200 len: 1576 microversion: 2.1 time: 0.154868 Aug 12 01:40:53.709405 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 518/1028] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:40:53 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:40:54.734172 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-a00fd56c-76f1-45de-896c-b2a6b46b3053 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:40:54.735154 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-a00fd56c-76f1-45de-896c-b2a6b46b3053 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:40:54.746030 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a00fd56c-76f1-45de-896c-b2a6b46b3053 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:54.746829 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a00fd56c-76f1-45de-896c-b2a6b46b3053 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:54.747584 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a00fd56c-76f1-45de-896c-b2a6b46b3053 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:54.748714 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a00fd56c-76f1-45de-896c-b2a6b46b3053 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:54.749459 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a00fd56c-76f1-45de-896c-b2a6b46b3053 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:54.750159 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-a00fd56c-76f1-45de-896c-b2a6b46b3053 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:54.885485 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-a00fd56c-76f1-45de-896c-b2a6b46b3053 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ab248227c94fcfaece38eb39d46787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b8427c88df4709b8ff7e395d93f89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:40:54.893677 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-a00fd56c-76f1-45de-896c-b2a6b46b3053 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 200 len: 1576 microversion: 2.1 time: 0.166047 Aug 12 01:40:54.894241 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 511/1029] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:40:54 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:40:55.919183 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-9e234595-670a-4a32-a785-c2947ed0c489 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:40:55.920114 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-9e234595-670a-4a32-a785-c2947ed0c489 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:40:55.930252 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9e234595-670a-4a32-a785-c2947ed0c489 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:55.930735 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9e234595-670a-4a32-a785-c2947ed0c489 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:55.931165 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9e234595-670a-4a32-a785-c2947ed0c489 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:55.931906 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9e234595-670a-4a32-a785-c2947ed0c489 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:55.932357 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9e234595-670a-4a32-a785-c2947ed0c489 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:55.932797 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-9e234595-670a-4a32-a785-c2947ed0c489 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:56.080870 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-9e234595-670a-4a32-a785-c2947ed0c489 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ab248227c94fcfaece38eb39d46787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b8427c88df4709b8ff7e395d93f89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:40:56.089062 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-9e234595-670a-4a32-a785-c2947ed0c489 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 200 len: 1576 microversion: 2.1 time: 0.176912 Aug 12 01:40:56.089644 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 519/1030] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:40:55 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 1576 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:40:57.110644 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-93404953-dad6-405d-8b55-b0e5f340b0db tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:40:57.111257 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-93404953-dad6-405d-8b55-b0e5f340b0db tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:40:57.118594 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-93404953-dad6-405d-8b55-b0e5f340b0db tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:57.119076 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-93404953-dad6-405d-8b55-b0e5f340b0db tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:57.119508 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-93404953-dad6-405d-8b55-b0e5f340b0db tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:57.120232 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-93404953-dad6-405d-8b55-b0e5f340b0db tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:57.120683 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-93404953-dad6-405d-8b55-b0e5f340b0db tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:57.121101 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-93404953-dad6-405d-8b55-b0e5f340b0db tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:57.259982 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-93404953-dad6-405d-8b55-b0e5f340b0db tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ab248227c94fcfaece38eb39d46787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b8427c88df4709b8ff7e395d93f89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:40:57.267566 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-93404953-dad6-405d-8b55-b0e5f340b0db tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 200 len: 1563 microversion: 2.1 time: 0.160893 Aug 12 01:40:57.268153 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 512/1031] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:40:57 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:40:59.333959 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-4b7233d0-997a-4adc-97c2-fe695cec1d89 req-7a90c7ae-4a68-4493-af16-528889a1cd19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58cf9e5c-f472-4561-86d1-8957f7a46e76", "name": "network-vif-plugged", "status": "completed", "tag": "c51c81c0-090a-4ff7-af49-a4ffd522196b"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:40:59.345379 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-4b7233d0-997a-4adc-97c2-fe695cec1d89 req-7a90c7ae-4a68-4493-af16-528889a1cd19 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:40:59.345995 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-4b7233d0-997a-4adc-97c2-fe695cec1d89 req-7a90c7ae-4a68-4493-af16-528889a1cd19 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:40:59.346423 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-4b7233d0-997a-4adc-97c2-fe695cec1d89 req-7a90c7ae-4a68-4493-af16-528889a1cd19 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:40:59.358334 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-4b7233d0-997a-4adc-97c2-fe695cec1d89 req-7a90c7ae-4a68-4493-af16-528889a1cd19 service nova] Creating event network-vif-plugged:c51c81c0-090a-4ff7-af49-a4ffd522196b for instance 58cf9e5c-f472-4561-86d1-8957f7a46e76 on hv-cinder-78481 Aug 12 01:40:59.363488 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-4b7233d0-997a-4adc-97c2-fe695cec1d89 req-7a90c7ae-4a68-4493-af16-528889a1cd19 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033444 Aug 12 01:40:59.364284 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 520/1032] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:41:56.413055 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 01:41:56.414031 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Fri Aug 12 01:41:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 01:42:13.880598 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-1aff2c48-b3f3-428a-afb9-6cbb71c1d32c tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:42:13.881313 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-1aff2c48-b3f3-428a-afb9-6cbb71c1d32c tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:42:13.881642 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_api:SELECT=26 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:42:13.882770 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG dbcounter [-] [120786] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:42:13.883945 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:42:13.884693 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG dbcounter [-] [120785] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120785) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:42:13.888877 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-8576dfee-730e-478e-80ad-5dcaecc7a284 req-f407db55-ba9e-4af9-8167-712cee6ccebd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58cf9e5c-f472-4561-86d1-8957f7a46e76", "tag": "c51c81c0-090a-4ff7-af49-a4ffd522196b"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:42:13.889951 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1aff2c48-b3f3-428a-afb9-6cbb71c1d32c tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:42:13.890628 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1aff2c48-b3f3-428a-afb9-6cbb71c1d32c tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:42:13.891220 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1aff2c48-b3f3-428a-afb9-6cbb71c1d32c tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:42:13.892007 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1aff2c48-b3f3-428a-afb9-6cbb71c1d32c tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:42:13.892545 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1aff2c48-b3f3-428a-afb9-6cbb71c1d32c tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:42:13.893019 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-1aff2c48-b3f3-428a-afb9-6cbb71c1d32c tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:42:13.901754 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-8576dfee-730e-478e-80ad-5dcaecc7a284 req-f407db55-ba9e-4af9-8167-712cee6ccebd service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:42:13.902224 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-8576dfee-730e-478e-80ad-5dcaecc7a284 req-f407db55-ba9e-4af9-8167-712cee6ccebd service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:42:13.902652 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-8576dfee-730e-478e-80ad-5dcaecc7a284 req-f407db55-ba9e-4af9-8167-712cee6ccebd service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:42:13.916268 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-8576dfee-730e-478e-80ad-5dcaecc7a284 req-f407db55-ba9e-4af9-8167-712cee6ccebd service nova] Creating event network-changed:c51c81c0-090a-4ff7-af49-a4ffd522196b for instance 58cf9e5c-f472-4561-86d1-8957f7a46e76 on hv-cinder-78481 Aug 12 01:42:13.922089 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-1aff2c48-b3f3-428a-afb9-6cbb71c1d32c tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Going to try to terminate instance {{(pid=120785) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 01:42:13.922300 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-8576dfee-730e-478e-80ad-5dcaecc7a284 req-f407db55-ba9e-4af9-8167-712cee6ccebd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043442 Aug 12 01:42:13.922903 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 521/1033] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:42:14.004356 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-1aff2c48-b3f3-428a-afb9-6cbb71c1d32c tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "DELETE /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 204 len: 0 microversion: 2.1 time: 0.128080 Aug 12 01:42:14.004728 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 513/1034] 10.222.0.20 () {58 vars in 1239 bytes} [Fri Aug 12 01:42:13 2022] DELETE /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 01:42:14.014924 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-c08ab93b-1ff7-4b9a-9e99-3e2e54144137 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:42:14.015798 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-c08ab93b-1ff7-4b9a-9e99-3e2e54144137 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:42:14.024200 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c08ab93b-1ff7-4b9a-9e99-3e2e54144137 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:42:14.024762 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c08ab93b-1ff7-4b9a-9e99-3e2e54144137 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:42:14.025259 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c08ab93b-1ff7-4b9a-9e99-3e2e54144137 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:42:14.026105 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c08ab93b-1ff7-4b9a-9e99-3e2e54144137 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:42:14.026566 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c08ab93b-1ff7-4b9a-9e99-3e2e54144137 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:42:14.026982 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-c08ab93b-1ff7-4b9a-9e99-3e2e54144137 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:42:14.167560 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.policy [None req-c08ab93b-1ff7-4b9a-9e99-3e2e54144137 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ab248227c94fcfaece38eb39d46787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b8427c88df4709b8ff7e395d93f89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120786) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:42:14.177489 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-c08ab93b-1ff7-4b9a-9e99-3e2e54144137 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 200 len: 1569 microversion: 2.1 time: 0.166975 Aug 12 01:42:14.186966 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 522/1035] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:42:14 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:42:15.200784 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-6596845b-a6de-4b21-8dd0-fc322927395c tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:42:15.201501 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-6596845b-a6de-4b21-8dd0-fc322927395c tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:42:15.208345 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6596845b-a6de-4b21-8dd0-fc322927395c tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:42:15.208811 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6596845b-a6de-4b21-8dd0-fc322927395c tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:42:15.209245 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6596845b-a6de-4b21-8dd0-fc322927395c tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:42:15.209933 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6596845b-a6de-4b21-8dd0-fc322927395c tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:42:15.210379 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6596845b-a6de-4b21-8dd0-fc322927395c tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:42:15.210925 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-6596845b-a6de-4b21-8dd0-fc322927395c tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:42:15.346639 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-6596845b-a6de-4b21-8dd0-fc322927395c tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ab248227c94fcfaece38eb39d46787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b8427c88df4709b8ff7e395d93f89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:42:15.355636 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-6596845b-a6de-4b21-8dd0-fc322927395c tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 200 len: 1569 microversion: 2.1 time: 0.159212 Aug 12 01:42:15.356603 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 514/1036] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:42:15 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:42:15.988528 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [req-f418d37a-acb5-4296-aad2-914d252b8a68 req-ca014ee9-1c04-440c-8468-b293a2752e49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58cf9e5c-f472-4561-86d1-8957f7a46e76", "name": "network-vif-deleted", "tag": "c51c81c0-090a-4ff7-af49-a4ffd522196b"}]} {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 01:42:16.001091 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-f418d37a-acb5-4296-aad2-914d252b8a68 req-ca014ee9-1c04-440c-8468-b293a2752e49 service nova] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:42:16.001655 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-f418d37a-acb5-4296-aad2-914d252b8a68 req-ca014ee9-1c04-440c-8468-b293a2752e49 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:42:16.002086 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [req-f418d37a-acb5-4296-aad2-914d252b8a68 req-ca014ee9-1c04-440c-8468-b293a2752e49 service nova] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:42:16.014240 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.compute.server_external_events [req-f418d37a-acb5-4296-aad2-914d252b8a68 req-ca014ee9-1c04-440c-8468-b293a2752e49 service nova] Creating event network-vif-deleted:c51c81c0-090a-4ff7-af49-a4ffd522196b for instance 58cf9e5c-f472-4561-86d1-8957f7a46e76 on hv-cinder-78481 Aug 12 01:42:16.020338 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [req-f418d37a-acb5-4296-aad2-914d252b8a68 req-ca014ee9-1c04-440c-8468-b293a2752e49 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035592 Aug 12 01:42:16.020954 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 523/1037] 10.222.0.20 () {64 vars in 1317 bytes} [Fri Aug 12 01:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 01:42:16.376683 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-9d575ae2-3be3-4b5e-b995-ae3676f97540 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:42:16.377441 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.compute.api [None req-9d575ae2-3be3-4b5e-b995-ae3676f97540 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120785) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:42:16.385000 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9d575ae2-3be3-4b5e-b995-ae3676f97540 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:42:16.385484 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9d575ae2-3be3-4b5e-b995-ae3676f97540 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:42:16.386109 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9d575ae2-3be3-4b5e-b995-ae3676f97540 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:42:16.387009 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9d575ae2-3be3-4b5e-b995-ae3676f97540 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:42:16.387414 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9d575ae2-3be3-4b5e-b995-ae3676f97540 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:42:16.388071 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9d575ae2-3be3-4b5e-b995-ae3676f97540 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:42:16.423855 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9d575ae2-3be3-4b5e-b995-ae3676f97540 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:42:16.424336 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9d575ae2-3be3-4b5e-b995-ae3676f97540 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:42:16.424793 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG oslo_concurrency.lockutils [None req-9d575ae2-3be3-4b5e-b995-ae3676f97540 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120785) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:42:16.425241 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.objects.instance [None req-9d575ae2-3be3-4b5e-b995-ae3676f97540 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lazy-loading 'fault' on Instance uuid 58cf9e5c-f472-4561-86d1-8957f7a46e76 {{(pid=120785) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 01:42:16.466462 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.policy [None req-9d575ae2-3be3-4b5e-b995-ae3676f97540 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ab248227c94fcfaece38eb39d46787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b8427c88df4709b8ff7e395d93f89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120785) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 01:42:16.473908 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-9d575ae2-3be3-4b5e-b995-ae3676f97540 tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 200 len: 1225 microversion: 2.1 time: 0.101462 Aug 12 01:42:16.474465 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 515/1038] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:42:16 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 01:42:17.500927 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-b54acb2c-1c34-461b-a654-5bb08dc004ce tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '>' {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:42:17.502068 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.compute.api [None req-b54acb2c-1c34-461b-a654-5bb08dc004ce tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [instance: 58cf9e5c-f472-4561-86d1-8957f7a46e76] Fetching instance by UUID {{(pid=120786) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 01:42:17.510909 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b54acb2c-1c34-461b-a654-5bb08dc004ce tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:42:17.511403 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b54acb2c-1c34-461b-a654-5bb08dc004ce tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:42:17.511867 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b54acb2c-1c34-461b-a654-5bb08dc004ce tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:42:17.512585 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b54acb2c-1c34-461b-a654-5bb08dc004ce tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Acquiring lock "330ae0cc-8e41-4294-877c-2d5d49260da2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 01:42:17.513006 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b54acb2c-1c34-461b-a654-5bb08dc004ce tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 01:42:17.513424 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG oslo_concurrency.lockutils [None req-b54acb2c-1c34-461b-a654-5bb08dc004ce tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Lock "330ae0cc-8e41-4294-877c-2d5d49260da2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 01:42:17.527278 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.wsgi [None req-b54acb2c-1c34-461b-a654-5bb08dc004ce tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] HTTP exception thrown: Instance 58cf9e5c-f472-4561-86d1-8957f7a46e76 could not be found. Aug 12 01:42:17.528985 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-b54acb2c-1c34-461b-a654-5bb08dc004ce tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Request method failure captured: Aug 12 01:42:17.528985 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: request: GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 HTTP/1.1 Aug 12 01:42:17.528985 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept: application/json Aug 12 01:42:17.528985 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Accept-Encoding: identity Aug 12 01:42:17.528985 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Connection: close Aug 12 01:42:17.528985 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Length: 0 Aug 12 01:42:17.528985 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Content-Type: application/json Aug 12 01:42:17.528985 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Host: 10.222.0.20 Aug 12 01:42:17.528985 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Openstack-System-Scope: None Aug 12 01:42:17.528985 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: User-Agent: python-urllib3/1.26.11 Aug 12 01:42:17.528985 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Auth-Token: gAAAAABi9a716WgZxE1zyDN5GNB0p43K2sL84Inl9qFoS3YVvuUj_04ENSeRUrIit94a69kXmXzqE-sGd-lP8AR4NPSN3hiXERKv-isHz1NXl9STAZ6JRtwbsfKDBLSGGlfIYygA7X145DFmlRa_sKAicYf10JX5vuIk4ZM3ne__MqgvwU-MG34 Aug 12 01:42:17.528985 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Id: None Aug 12 01:42:17.528985 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Domain-Name: None Aug 12 01:42:17.528985 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Identity-Status: Confirmed Aug 12 01:42:17.528985 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Is-Admin-Project: True Aug 12 01:42:17.528985 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Id: default Aug 12 01:42:17.528985 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Domain-Name: Default Aug 12 01:42:17.528985 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Id: 29b8427c88df4709b8ff7e395d93f89d Aug 12 01:42:17.528985 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Project-Name: tempest-TestShelveInstance-970718129 Aug 12 01:42:17.528985 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Role: member,reader Aug 12 01:42:17.528985 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Roles: member,reader Aug 12 01:42:17.530752 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/29b8427c88df4709b8ff7e395d93f89d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29b8427c88df4709b8ff7e395d93f89d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_29b8427c88df4709b8ff7e395d93f89d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29b8427c88df4709b8ff7e395d93f89d"}]}] Aug 12 01:42:17.530752 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant: tempest-TestShelveInstance-970718129 Aug 12 01:42:17.530752 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Id: 29b8427c88df4709b8ff7e395d93f89d Aug 12 01:42:17.530752 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-Tenant-Name: tempest-TestShelveInstance-970718129 Aug 12 01:42:17.530752 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User: tempest-TestShelveInstance-970718129-project Aug 12 01:42:17.530752 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Id: default Aug 12 01:42:17.530752 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Domain-Name: Default Aug 12 01:42:17.530752 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Id: 48ab248227c94fcfaece38eb39d46787 Aug 12 01:42:17.530752 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: X-User-Name: tempest-TestShelveInstance-970718129-project Aug 12 01:42:17.530752 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: method: > Aug 12 01:42:17.530752 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: exception: Instance 58cf9e5c-f472-4561-86d1-8957f7a46e76 could not be found. Aug 12 01:42:17.530752 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: action_args: {'id': '58cf9e5c-f472-4561-86d1-8957f7a46e76'} Aug 12 01:42:17.531892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: {{(pid=120786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 01:42:17.531892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:42:17.531892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 01:42:17.531892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 01:42:17.531892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 01:42:17.531892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 01:42:17.531892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 01:42:17.531892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 01:42:17.531892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 01:42:17.531892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 01:42:17.531892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58cf9e5c-f472-4561-86d1-8957f7a46e76 could not be found. Aug 12 01:42:17.531892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:42:17.531892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:42:17.531892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:42:17.531892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:42:17.531892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:42:17.531892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:42:17.531892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 01:42:17.531892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 01:42:17.531892 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 01:42:17.533542 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 01:42:17.533542 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 01:42:17.533542 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 01:42:17.533542 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 01:42:17.533542 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 01:42:17.533542 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 01:42:17.533542 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 01:42:17.533542 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58cf9e5c-f472-4561-86d1-8957f7a46e76 could not be found. Aug 12 01:42:17.533542 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:42:17.533542 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 01:42:17.533542 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:42:17.533542 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 01:42:17.533542 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 01:42:17.533542 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 01:42:17.533542 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 01:42:17.533542 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 01:42:17.533542 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58cf9e5c-f472-4561-86d1-8957f7a46e76 could not be found. Aug 12 01:42:17.533542 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: ERROR nova.api.openstack.wsgi Aug 12 01:42:17.535078 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: DEBUG nova.api.openstack.wsgi [None req-b54acb2c-1c34-461b-a654-5bb08dc004ce tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Returning 404 to user: Instance 58cf9e5c-f472-4561-86d1-8957f7a46e76 could not be found. {{(pid=120786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 01:42:17.535078 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO nova.api.openstack.requestlog [None req-b54acb2c-1c34-461b-a654-5bb08dc004ce tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76" status: 404 len: 111 microversion: 2.1 time: 0.036568 Aug 12 01:42:17.535078 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: [pid: 120786|app: 0|req: 524/1039] 10.222.0.20 () {58 vars in 1236 bytes} [Fri Aug 12 01:42:17 2022] GET /compute/v2.1/servers/58cf9e5c-f472-4561-86d1-8957f7a46e76 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 01:42:17.706866 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: DEBUG nova.api.openstack.wsgi [None req-7e2f56d8-e8d4-437a-85cd-4b83aaff9b9b tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] Calling method '.version_select at 0x7f2decff8f70>' {{(pid=120785) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 01:42:17.711547 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7e2f56d8-e8d4-437a-85cd-4b83aaff9b9b tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [97c7a8f1-88b0-499f-a87f-02c025c1db50] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 12 01:42:18.719971 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO oslo.messaging._drivers.impl_rabbit [None req-7e2f56d8-e8d4-437a-85cd-4b83aaff9b9b tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] [97c7a8f1-88b0-499f-a87f-02c025c1db50] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50358. Aug 12 01:42:18.743986 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO nova.api.openstack.requestlog [None req-7e2f56d8-e8d4-437a-85cd-4b83aaff9b9b tempest-TestShelveInstance-970718129 tempest-TestShelveInstance-970718129-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1036399014" status: 202 len: 0 microversion: 2.1 time: 1.040987 Aug 12 01:42:18.744575 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: [pid: 120785|app: 0|req: 516/1040] 10.222.0.20 () {58 vars in 1254 bytes} [Fri Aug 12 01:42:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1036399014 => generated 0 bytes in 1042 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 01:43:13.604896 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 01:43:13.605972 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Fri Aug 12 01:43:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 01:43:14.232284 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 01:43:14.232687 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Fri Aug 12 01:43:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 01:43:20.150861 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 01:43:20.151457 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Fri Aug 12 01:43:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 01:45:11.537232 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 01:45:11.538131 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Fri Aug 12 01:45:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 01:45:16.424399 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 01:45:16.425339 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Fri Aug 12 01:45:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 01:46:33.618224 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 01:46:33.619109 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Fri Aug 12 01:46:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 01:46:34.246189 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 01:46:34.246607 dv-cinder-784815-15-iscsi devstack@n-api.service[120786]: Fri Aug 12 01:46:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 01:46:40.160654 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 01:46:40.161211 dv-cinder-784815-15-iscsi devstack@n-api.service[120785]: Fri Aug 12 01:46:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!